Sep 04 05:48:53 devstack cinder-volume[76168]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 05:48:53 devstack cinder-volume[76168]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 05:48:53 devstack cinder-volume[76168]: we strongly recommend against using it for new projects. Sep 04 05:48:53 devstack cinder-volume[76168]: If you are already using Eventlet, we recommend migrating to a different Sep 04 05:48:53 devstack cinder-volume[76168]: framework. For more detail see Sep 04 05:48:53 devstack cinder-volume[76168]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 05:48:53 devstack cinder-volume[76168]: import eventlet # noqa Sep 04 05:48:56 devstack cinder-volume[76168]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 05:48:56 devstack cinder-volume[76168]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 05:48:56 devstack cinder-volume[76168]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 05:48:56 devstack cinder-volume[76168]: INFO dbcounter [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Registered counter for database cinder Sep 04 05:48:57 devstack cinder-volume[76168]: DEBUG oslo_db.sqlalchemy.engines [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76168) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:48:57 devstack cinder-volume[76168]: DEBUG dbcounter [-] [76168] Writer thread running {{(pid=76168) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 05:48:57 devstack cinder-volume[76168]: INFO cinder.rpc [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 05:48:57 devstack cinder-volume[76168]: INFO cinder.rpc [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 05:48:57 devstack cinder-volume[76168]: DEBUG oslo_db.sqlalchemy.engines [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76168) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:48:57 devstack cinder-volume[76168]: INFO cinder.volume.manager [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Determined volume DB was empty at startup. Sep 04 05:48:57 devstack cinder-volume[76168]: DEBUG cinder.volume.manager [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76168) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 05:48:57 devstack cinder-volume[76168]: INFO cinder.volume.manager [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 04 05:48:57 devstack cinder-volume[76168]: WARNING stevedore.named [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 05:48:57 devstack cinder-volume[76168]: WARNING castellan.key_manager [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 05:48:57 devstack cinder-volume[76168]: WARNING cinder.keymgr.conf_key_mgr [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 05:48:57 devstack cinder-volume[76168]: DEBUG cinder.volume.drivers.lvm [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76168) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 04 05:48:57 devstack cinder-volume[76168]: DEBUG oslo_concurrency.processutils [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76168) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_concurrency.processutils [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] CMD "cinder-rtstool verify" returned: 0 in 0.502s {{(pid=76168) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_db.sqlalchemy.engines [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76168) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:48:58 devstack cinder-volume[76168]: INFO cinder.rpc [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 04 05:48:58 devstack cinder-volume[76168]: INFO cinder.rpc [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 04 05:48:58 devstack cinder-volume[76168]: WARNING stevedore.named [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 05:48:58 devstack cinder-volume[76168]: WARNING castellan.key_manager [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 05:48:58 devstack cinder-volume[76168]: INFO cinder.volume.manager [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_db.sqlalchemy.engines [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76168) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:48:58 devstack cinder-volume[76168]: INFO oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Starting 1 workers Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Started child 76337 {{(pid=76168) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Full set of CONF: {{(pid=76168) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] ******************************************************************************** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Configuration options gathered from: {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] ================================================================================ {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 05:48:58 devstack cinder-volume[76337]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] allow_availability_zone_fallback = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] allow_compression_on_image_upload = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] allowed_direct_url_schemes = [] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] api_rate_limit = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] auth_strategy = keystone {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] az_cache_duration = 3600 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_availability_zone = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_host = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_name = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_stats_polling_interval = 60 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backup_api_class = cinder.backup.api.API {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backup_name_template = backup-%s {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backup_use_same_host = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backup_use_temp_snapshot = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] chap_password = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] chap_username = {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cinder_internal_tenant_project_id = 22602904548447b1b77b7f680113e41c {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cinder_internal_tenant_user_id = f804646ed97040cfb9c0a4328112fc41 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cloned_volume_same_az = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cluster = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] compression_format = gzip {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] compute_api_class = cinder.compute.nova.API {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] config_dir = [] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] config_source = [] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] control_exchange = openstack {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] debug = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] default_availability_zone = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] default_group_type = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] default_volume_type = lvmdriver-1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] disk_geometry = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] driver_client_cert = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] driver_client_cert_key = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] driver_data_namespace = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] driver_ssl_cert_path = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] driver_ssl_cert_verify = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] driver_use_ssl = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] enable_force_upload = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] enable_new_services = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] enable_unsupported_driver = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] enabled_backends = ['lvmdriver-1'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] enforce_multipath_for_image_xfer = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] filter_function = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance_api_insecure = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance_api_servers = ['http://192.168.122.10/image'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance_api_ssl_compression = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance_ca_certificates_file = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance_catalog_info = image:glance:publicURL {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance_certfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance_keyfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance_num_retries = 3 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance_request_timeout = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] goodness_function = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] graceful_shutdown_timeout = 5 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] group_api_class = cinder.group.api.API {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] host = devstack {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] image_compress_on_upload = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] image_conversion_address_space_limit = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] image_conversion_cpu_limit = 60 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] image_conversion_disable = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] image_upload_use_cinder_backend = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] image_upload_use_internal_tenant = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] image_volume_cache_enabled = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] image_volume_cache_max_count = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] image_volume_cache_max_size_gb = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] init_host_max_objects_retrieval = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] instance_format = [instance: %(uuid)s] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] iscsi_target_flags = {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] iscsi_write_cache = on {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] iser_helper = tgtadm {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] iser_ip_address = 192.168.122.10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] iser_port = 3260 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] log_color = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] log_config_append = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76337]: INFO cinder.volume.manager [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] log_dir = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] log_file = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] log_options = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] log_rotate_interval = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] log_rotate_interval_type = days {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] log_rotation_type = none {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] max_age = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] max_logfile_count = 30 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] max_logfile_size_mb = 200 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] max_over_subscription_ratio = 20.0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] message_reap_interval = 86400 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] message_ttl = 2592000 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] migration_create_volume_timeout_secs = 300 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] monkey_patch = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] monkey_patch_modules = [] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] my_ip = 192.168.122.10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] no_snapshot_gb_quota = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] num_iser_scan_tries = 3 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] num_shell_tries = 3 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] num_volume_device_scan_tries = 3 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] nvmeof_conn_info_version = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] nvmet_ns_id = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] nvmet_port_id = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] osapi_max_limit = 1000 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] osapi_volume_ext_list = [] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] osapi_volume_listen = 0.0.0.0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] osapi_volume_listen_port = 8776 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] osapi_volume_use_ssl = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] osapi_volume_workers = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] per_volume_size_limit = -1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] periodic_fuzzy_delay = 60 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] periodic_interval = 60 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] project_id_regex = [0-9a-f\-]+ {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] public_endpoint = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] publish_errors = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] quota_backup_gigabytes = 1000 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] quota_backups = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] quota_gigabytes = 1000 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] quota_groups = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] quota_snapshots = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] quota_volumes = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] rate_limit_burst = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] rate_limit_except_level = CRITICAL {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] rate_limit_interval = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] reinit_driver_count = 3 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] replication_device = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] report_discard_supported = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] report_interval = 120 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] reservation_clean_interval = 86400 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] reservation_expire = 86400 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] reserved_image_namespaces = [] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] reserved_percentage = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] rpc_response_timeout = 120 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] run_external_periodic_tasks = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] scst_target_driver = iscsi {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] scst_target_iqn_name = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_down_time = 720 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] shell_completion = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] snapshot_name_template = snapshot-%s {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] snapshot_same_host = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] split_loggers = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] state_path = /opt/stack/data/cinder {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] storage_availability_zone = nova {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] storage_protocol = iSCSI {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] syslog_log_facility = LOG_USER {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] target_helper = lioadm {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] target_ip_address = 192.168.122.10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] target_port = 3260 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] target_protocol = iscsi {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] target_secondary_ip_addresses = [] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] trace_flags = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] transfer_api_class = cinder.transfer.api.API {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] transport_url = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] until_refresh = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] use_chap_auth = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] use_default_quota_class = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] use_journal = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] use_json = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] use_multipath_for_image_xfer = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] use_stderr = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] use_syslog = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] verify_glance_signatures = enabled {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volume_api_class = cinder.volume.api.API {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volume_backend_name = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volume_clear = zero {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volume_clear_ionice = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volume_clear_size = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volume_copy_bps_limit = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volume_dd_blocksize = 1M {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volume_name_template = volume-%s {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volume_service_inithost_offload = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volume_usage_audit_period = month {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] zoning_mode = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_concurrency.disable_process_locking = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.auth_section = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.auth_type = password {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.auth_version = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.cache = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.certfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.delay_auth_decision = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.http_connect_timeout = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.include_service_catalog = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.insecure = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.interface = public {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.keyfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_password = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcache_username = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.region_name = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.service_token_roles_required = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.service_type = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.token_cache_time = 300 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.10/identity {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.backend = dogpile.cache.null {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.backend_argument = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.backend_expiration_time = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.config_prefix = cache.oslo {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.debug_cache_backend = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.enable_retry_client = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.enable_socket_keepalive = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.enabled = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.expiration_time = 600 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.hashclient_retry_attempts = 2 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.memcache_dead_retry = 300 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.memcache_pool_maxsize = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.memcache_sasl_enabled = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.password = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.proxies = [] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.redis_db = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.redis_sentinel_service_name = mymaster {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.redis_server = localhost:6379 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.retry_attempts = 2 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.retry_delay = 0.0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.socket_keepalive_count = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.socket_keepalive_idle = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.socket_keepalive_interval = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.088s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:48:58 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.socket_timeout = 1.0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.tls_allowed_ciphers = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.tls_cafile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.tls_certfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.tls_enabled = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.tls_keyfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cache.username = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] coordination.backend_url = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.asyncio_connection = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.asyncio_slave_connection = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.backend = sqlalchemy {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.connection = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.connection_debug = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.connection_parameters = {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.connection_recycle_time = 3600 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.connection_trace = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.db_inc_retry_interval = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.db_max_retries = 20 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.db_max_retry_interval = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.db_retry_interval = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.max_overflow = 50 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.max_pool_size = 5 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.max_retries = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.mysql_wsrep_sync_wait = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.pool_timeout = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.retry_interval = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.slave_connection = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.sqlite_synchronous = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.synchronous_reader = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] database.use_db_reconnect = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_tracing.insecure = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler.connection_string = messaging:// {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler.enabled = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler.es_doc_type = notification {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler.es_scroll_size = 10000 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler.es_scroll_time = 2m {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler.filter_error_trace = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler.hmac_keys = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler.sentinel_service_name = mymaster {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler.socket_timeout = 0.1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler.trace_requests = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler.trace_sqlalchemy = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler_jaeger.process_tags = {} {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler_jaeger.service_name_prefix = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] profiler_otlp.service_name_prefix = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_policy.enforce_new_defaults = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_policy.policy_default_rule = default {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_policy.policy_file = policy.yaml {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_policy.remote_timeout = 60.0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] privsep_osbrick.group = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] privsep_osbrick.helper_command = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] privsep_osbrick.user = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cinder_sys_admin.group = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cinder_sys_admin.helper_command = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] cinder_sys_admin.user = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_user.auth_section = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_user.auth_type = password {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_user.cafile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_user.certfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_user.collect_timing = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_user.insecure = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_user.keyfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_user.send_service_user_token = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_user.split_loggers = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_user.timeout = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_user.tls_ciphers = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] service_user.tls_min_version = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance.auth_section = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance.auth_type = password {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance.certfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance.collect_timing = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance.insecure = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance.keyfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance.region_name = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance.split_loggers = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance.timeout = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance.tls_ciphers = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] glance.tls_min_version = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.backend_availability_zone = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.chap_password = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.chap_username = {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.disk_geometry = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.driver_client_cert = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.driver_client_cert_key = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.driver_data_namespace = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.driver_use_ssl = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.enable_unsupported_driver = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.extra_capabilities = {} {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.filter_function = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.goodness_function = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.iscsi_target_flags = {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.iscsi_write_cache = on {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.iser_helper = tgtadm {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.iser_ip_address = 192.168.122.10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.iser_port = 3260 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.lvm_mirrors = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.lvm_share_target = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.lvm_type = auto {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.num_shell_tries = 3 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.nvmet_port_id = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.replication_device = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.report_discard_supported = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.reserved_percentage = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.scst_target_driver = iscsi {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.scst_target_iqn_name = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.storage_protocol = iSCSI {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.target_helper = tgtadm {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.target_ip_address = 192.168.122.10 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.target_port = 3260 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack sudo[76341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.target_protocol = iscsi {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.trace_flags = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.unique_fqdn_network = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.use_chap_auth = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack sudo[76341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.volume_backend_name = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.volume_clear = zero {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.volume_clear_ionice = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.volume_clear_size = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.volume_group = cinder-volumes {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_reports.file_event_handler = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_reports.log_dir = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.backend_availability_zone = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.backend_host = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.chap_password = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.chap_username = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.chiscsi_conf = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.disk_geometry = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.driver_client_cert = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.driver_data_namespace = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.driver_use_ssl = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.extra_capabilities = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.filter_function = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.goodness_function = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.iser_helper = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.iser_ip_address = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.iser_port = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.iser_target_prefix = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.lvm_conf_file = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.lvm_mirrors = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.lvm_share_target = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.lvm_type = auto {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.num_shell_tries = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.nvmet_port_id = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.replication_device = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.report_discard_supported = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.reserved_percentage = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.scst_target_driver = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.storage_protocol = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.target_helper = lioadm {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.target_ip_address = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.target_port = 3260 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.target_protocol = iscsi {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.trace_flags = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.use_chap_auth = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.volume_clear = zero {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.volume_clear_size = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] lvmdriver-1.volumes_dir = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.ssl = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.ssl_version = {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_notifications.driver = [] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_notifications.retry = -1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] oslo_messaging_notifications.transport_url = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] key_manager.fixed_key = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.barbican_api_version = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.barbican_endpoint = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.barbican_endpoint_type = public {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.barbican_region_name = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.cafile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.certfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.collect_timing = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.insecure = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.keyfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.number_of_retries = 60 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.retry_delay = 1 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.send_service_user_token = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.split_loggers = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.timeout = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.tls_ciphers = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.tls_min_version = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.verify_ssl = True {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican.verify_ssl_path = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican_service_user.auth_section = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican_service_user.auth_type = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican_service_user.cafile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican_service_user.certfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican_service_user.collect_timing = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican_service_user.insecure = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican_service_user.keyfile = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican_service_user.split_loggers = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican_service_user.timeout = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican_service_user.tls_ciphers = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] barbican_service_user.tls_min_version = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.approle_role_id = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.approle_secret_id = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.auth_method = approle {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.auth_path = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.kv_mountpoint = secret {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.kv_path = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.kv_version = 2 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.namespace = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.root_token_id = **** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.ssl_ca_crt_file = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.timeout = 60.0 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.token_file = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.token_role = None {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.use_ssl = False {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:48:58 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] ******************************************************************************** {{(pid=76168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 05:48:59 devstack sudo[76341]: pam_unix(sudo:session): session closed for user root Sep 04 05:48:59 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.332s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:48:59 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:48:59 devstack sudo[76364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 05:48:59 devstack sudo[76364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:48:59 devstack sudo[76364]: pam_unix(sudo:session): session closed for user root Sep 04 05:48:59 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.259s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:48:59 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 05:48:59 devstack cinder-volume[76337]: INFO cinder.brick.local_dev.lvm [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 04 05:48:59 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:48:59 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:48:59 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:48:59 devstack sudo[76503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 05:48:59 devstack sudo[76503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:48:59 devstack sudo[76503]: pam_unix(sudo:session): session closed for user root Sep 04 05:48:59 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:48:59 devstack cinder-volume[76337]: DEBUG cinder.brick.local_dev.lvm [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76337) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 04 05:48:59 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:48:59 devstack sudo[76595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 05:48:59 devstack sudo[76595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:00 devstack sudo[76595]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:00 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.578s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:00 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:00 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:00 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:00 devstack sudo[76800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 05:49:00 devstack sudo[76800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:00 devstack sudo[76800]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:00 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.382s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:00 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:00 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:00 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:00 devstack sudo[76874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 04 05:49:00 devstack sudo[76874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:00 devstack sudo[76874]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:00 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.323s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:00 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:00 devstack sudo[76956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 05:49:00 devstack sudo[76956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:01 devstack sudo[76956]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:01 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:01 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:01 devstack sudo[77040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 05:49:01 devstack sudo[77040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:01 devstack sudo[77040]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:01 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:01 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:01 devstack sudo[77043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:49:01 devstack sudo[77043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:01 devstack sudo[77043]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:01 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:01 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:01 devstack sudo[77053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 05:49:01 devstack sudo[77053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:02 devstack sudo[77053]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.323s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:02 devstack sudo[77136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 05:49:02 devstack sudo[77136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:02 devstack sudo[77136]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:02 devstack cinder-volume[76337]: INFO cinder.volume.drivers.lvm [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:02 devstack sudo[77140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 05:49:02 devstack sudo[77140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:02 devstack sudo[77140]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG cinder.volume.drivers.lvm [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Updating volume stats {{(pid=76337) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:02 devstack sudo[77143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 05:49:02 devstack sudo[77143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:02 devstack sudo[77143]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:02 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:02 devstack sudo[77152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:49:02 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:03 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:03 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:03 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:03 devstack sudo[77155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 05:49:03 devstack sudo[77155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:03 devstack sudo[77155]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:03 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.238s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:03 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:03 devstack sudo[77158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:49:03 devstack sudo[77158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:03 devstack sudo[77158]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:03 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:03 devstack cinder-volume[76337]: INFO cinder.volume.driver [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 05:49:03 devstack cinder-volume[76337]: DEBUG cinder.volume.driver [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76337) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 05:49:03 devstack cinder-volume[76337]: DEBUG oslo_db.sqlalchemy.engines [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:49:03 devstack cinder-volume[76337]: DEBUG dbcounter [-] [76337] Writer thread running {{(pid=76337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 05:49:03 devstack cinder-volume[76337]: DEBUG cinder.db.api [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Building query based on filter {{(pid=76337) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 05:49:03 devstack cinder-volume[76337]: DEBUG cinder.image.image_utils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76337) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 05:49:03 devstack cinder-volume[76337]: INFO cinder.keymgr.migration [None req-3a683509-9ea9-4d72-8287-00fc774e78ee None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 05:49:03 devstack cinder-volume[76337]: DEBUG cinder.volume.drivers.lvm [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Updating volume stats {{(pid=76337) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 05:49:03 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:03 devstack sudo[77162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 05:49:03 devstack sudo[77162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:04 devstack sudo[77162]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:04 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:04 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:04 devstack sudo[77165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:49:04 devstack sudo[77165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:04 devstack sudo[77165]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:04 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:04 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:04 devstack sudo[77170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 05:49:04 devstack sudo[77170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:04 devstack sudo[77170]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:04 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:04 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:04 devstack sudo[77173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:49:04 devstack sudo[77173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:04 devstack sudo[77173]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:04 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:04 devstack cinder-volume[76337]: DEBUG cinder.manager [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Notifying Schedulers of capabilities ... {{(pid=76337) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:49:04 devstack cinder-volume[76337]: INFO cinder.volume.manager [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Driver initialization completed successfully. Sep 04 05:49:04 devstack cinder-volume[76337]: INFO cinder.manager [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Initiating service 2 cleanup Sep 04 05:49:04 devstack cinder-volume[76337]: INFO cinder.manager [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Service 2 cleanup completed. Sep 04 05:49:04 devstack cinder-volume[76337]: DEBUG cinder.service [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Creating RPC server for service cinder-volume {{(pid=76337) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 05:49:04 devstack cinder-volume[76337]: DEBUG cinder.service [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76337) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 05:49:05 devstack cinder-volume[76337]: INFO cinder.volume.manager [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 04 05:49:05 devstack cinder-volume[76337]: DEBUG cinder.volume.drivers.lvm [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Updating volume stats {{(pid=76337) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 05:49:05 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:05 devstack sudo[77176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 05:49:05 devstack sudo[77176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:05 devstack sudo[77176]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:05 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:05 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:05 devstack sudo[77179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:49:05 devstack sudo[77179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:05 devstack sudo[77179]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:05 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:05 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:05 devstack sudo[77185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 05:49:05 devstack sudo[77185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:05 devstack sudo[77185]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:05 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:05 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:49:05 devstack sudo[77189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:49:05 devstack sudo[77189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:49:06 devstack sudo[77189]: pam_unix(sudo:session): session closed for user root Sep 04 05:49:06 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:49:06 devstack cinder-volume[76337]: INFO cinder.volume.manager [None req-1cac48cc-0457-49ba-9746-8f861156c886 None None] Driver post RPC initialization completed successfully. Sep 04 05:49:08 devstack cinder-volume[76168]: DEBUG dbcounter [-] [76168] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76168) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:49:16 devstack cinder-volume[76337]: DEBUG dbcounter [-] [76337] Writing DB stats cinder:SELECT=3 {{(pid=76337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:49:16 devstack cinder-volume[76337]: DEBUG dbcounter [-] [76337] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:49:54 devstack cinder-volume[76337]: DEBUG oslo_service.periodic_task [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running periodic task VolumeManager._thread_info {{(pid=76337) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:49:54 devstack cinder-volume[76337]: DEBUG cinder.volume.manager [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] thread count: 6 {{(pid=76337) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 05:49:54 devstack cinder-volume[76337]: DEBUG cinder.volume.manager [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] thread info: [<_MainThread(MainThread, started 129318418661504)>, , , , , ] {{(pid=76337) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 05:50:54 devstack cinder-volume[76337]: DEBUG oslo_service.periodic_task [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76337) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:50:54 devstack cinder-volume[76337]: DEBUG cinder.volume.drivers.lvm [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Updating volume stats {{(pid=76337) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 05:50:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:50:54 devstack sudo[82420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 05:50:54 devstack sudo[82420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:50:54 devstack sudo[82420]: pam_unix(sudo:session): session closed for user root Sep 04 05:50:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:50:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:50:54 devstack sudo[82423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:50:54 devstack sudo[82423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:50:54 devstack sudo[82423]: pam_unix(sudo:session): session closed for user root Sep 04 05:50:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:50:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:50:54 devstack sudo[82426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 05:50:54 devstack sudo[82426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:50:54 devstack sudo[82426]: pam_unix(sudo:session): session closed for user root Sep 04 05:50:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:50:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:50:54 devstack sudo[82431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:50:54 devstack sudo[82431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:50:55 devstack sudo[82431]: pam_unix(sudo:session): session closed for user root Sep 04 05:50:55 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:50:55 devstack cinder-volume[76337]: DEBUG cinder.manager [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Notifying Schedulers of capabilities ... {{(pid=76337) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:50:55 devstack cinder-volume[76337]: DEBUG oslo_service.periodic_task [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running periodic task VolumeManager._thread_info {{(pid=76337) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:50:55 devstack cinder-volume[76337]: DEBUG cinder.volume.manager [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] thread count: 6 {{(pid=76337) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 05:50:55 devstack cinder-volume[76337]: DEBUG cinder.volume.manager [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] thread info: [<_MainThread(MainThread, started 129318418661504)>, , , , , ] {{(pid=76337) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 05:51:16 devstack cinder-volume[76337]: DEBUG dbcounter [-] [76337] Writing DB stats cinder:SELECT=1 {{(pid=76337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:51:16 devstack cinder-volume[76337]: DEBUG dbcounter [-] [76337] Writing DB stats cinder:UPDATE=1 {{(pid=76337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:51:54 devstack cinder-volume[76337]: DEBUG oslo_service.periodic_task [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76337) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:51:54 devstack cinder-volume[76337]: DEBUG cinder.volume.drivers.lvm [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Updating volume stats {{(pid=76337) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 05:51:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:51:54 devstack sudo[84344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 05:51:54 devstack sudo[84344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:51:54 devstack sudo[84344]: pam_unix(sudo:session): session closed for user root Sep 04 05:51:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:51:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:51:54 devstack sudo[84347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:51:54 devstack sudo[84347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:51:54 devstack sudo[84347]: pam_unix(sudo:session): session closed for user root Sep 04 05:51:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:51:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:51:54 devstack sudo[84370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 05:51:54 devstack sudo[84370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:51:54 devstack sudo[84370]: pam_unix(sudo:session): session closed for user root Sep 04 05:51:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:51:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:51:55 devstack sudo[84374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:51:55 devstack sudo[84374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:51:55 devstack sudo[84374]: pam_unix(sudo:session): session closed for user root Sep 04 05:51:55 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:51:55 devstack cinder-volume[76337]: DEBUG cinder.manager [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Notifying Schedulers of capabilities ... {{(pid=76337) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:52:54 devstack cinder-volume[76337]: DEBUG oslo_service.periodic_task [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76337) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:52:54 devstack cinder-volume[76337]: DEBUG cinder.volume.drivers.lvm [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Updating volume stats {{(pid=76337) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 05:52:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:52:54 devstack sudo[85690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 05:52:54 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:52:54 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root Sep 04 05:52:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:52:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:52:54 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:52:54 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:52:54 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Sep 04 05:52:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:52:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:52:54 devstack sudo[85697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 05:52:54 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:52:54 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root Sep 04 05:52:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:52:54 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:52:54 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 05:52:54 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:52:55 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Sep 04 05:52:55 devstack cinder-volume[76337]: DEBUG oslo_concurrency.processutils [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:52:55 devstack cinder-volume[76337]: DEBUG cinder.manager [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Notifying Schedulers of capabilities ... {{(pid=76337) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:52:55 devstack cinder-volume[76337]: DEBUG oslo_service.periodic_task [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] Running periodic task VolumeManager._thread_info {{(pid=76337) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:52:55 devstack cinder-volume[76337]: DEBUG cinder.volume.manager [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] thread count: 6 {{(pid=76337) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 05:52:55 devstack cinder-volume[76337]: DEBUG cinder.volume.manager [None req-8e519b14-363f-4372-8739-3dbd5fd80922 None None] thread info: [<_MainThread(MainThread, started 129318418661504)>, , , , , ] {{(pid=76337) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 05:53:16 devstack cinder-volume[76337]: DEBUG dbcounter [-] [76337] Writing DB stats cinder:SELECT=1 {{(pid=76337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:53:16 devstack cinder-volume[76337]: DEBUG dbcounter [-] [76337] Writing DB stats cinder:UPDATE=1 {{(pid=76337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:53:18 devstack cinder-volume[76168]: INFO oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Caught SIGTERM, stopping children Sep 04 05:53:18 devstack cinder-volume[76168]: DEBUG oslo_concurrency.lockutils [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Acquiring lock "singleton_lock" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 05:53:18 devstack cinder-volume[76168]: DEBUG oslo_concurrency.lockutils [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Acquired lock "singleton_lock" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 05:53:18 devstack cinder-volume[76168]: DEBUG oslo_concurrency.lockutils [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Releasing lock "singleton_lock" {{(pid=76168) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 05:53:18 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Stop services. {{(pid=76168) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 04 05:53:18 devstack cinder-volume[76168]: DEBUG oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Killing children. {{(pid=76168) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 04 05:53:18 devstack cinder-volume[76168]: INFO oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Waiting on 1 children to exit Sep 04 05:53:19 devstack cinder-volume[76337]: DEBUG oslo_concurrency.lockutils [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Acquiring lock "singleton_lock" {{(pid=76337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 05:53:19 devstack cinder-volume[76337]: DEBUG oslo_concurrency.lockutils [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Acquired lock "singleton_lock" {{(pid=76337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 05:53:19 devstack cinder-volume[76337]: DEBUG oslo_concurrency.lockutils [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Releasing lock "singleton_lock" {{(pid=76337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 05:53:20 devstack cinder-volume[76337]: WARNING amqp [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 05:53:20 devstack cinder-volume[76337]: WARNING amqp [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 05:53:20 devstack cinder-volume[76168]: INFO oslo_service.backend._eventlet.service [None req-634ab982-053a-4845-a290-f06cc7a12a4b None None] Child 76337 exited with status 0 Sep 04 05:53:20 devstack cinder-volume[86320]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 05:53:20 devstack cinder-volume[86320]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 05:53:20 devstack cinder-volume[86320]: we strongly recommend against using it for new projects. Sep 04 05:53:20 devstack cinder-volume[86320]: If you are already using Eventlet, we recommend migrating to a different Sep 04 05:53:20 devstack cinder-volume[86320]: framework. For more detail see Sep 04 05:53:20 devstack cinder-volume[86320]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 05:53:20 devstack cinder-volume[86320]: import eventlet # noqa Sep 04 05:53:22 devstack cinder-volume[86320]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 05:53:22 devstack cinder-volume[86320]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 05:53:22 devstack cinder-volume[86320]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 05:53:23 devstack cinder-volume[86320]: INFO dbcounter [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Registered counter for database cinder Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_db.sqlalchemy.engines [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG dbcounter [-] [86320] Writer thread running {{(pid=86320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 05:53:23 devstack cinder-volume[86320]: INFO cinder.rpc [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 05:53:23 devstack cinder-volume[86320]: INFO cinder.rpc [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_db.sqlalchemy.engines [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:53:23 devstack cinder-volume[86320]: INFO cinder.volume.manager [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Determined volume DB was empty at startup. Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG cinder.volume.manager [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86320) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 05:53:23 devstack cinder-volume[86320]: INFO cinder.volume.manager [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 04 05:53:23 devstack cinder-volume[86320]: WARNING stevedore.named [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 05:53:23 devstack cinder-volume[86320]: WARNING castellan.key_manager [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 05:53:23 devstack cinder-volume[86320]: WARNING cinder.keymgr.conf_key_mgr [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 05:53:23 devstack cinder-volume[86320]: INFO cinder.volume.manager [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_db.sqlalchemy.engines [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:53:23 devstack cinder-volume[86320]: INFO oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Starting 1 workers Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Started child 86535 {{(pid=86320) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Full set of CONF: {{(pid=86320) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] ******************************************************************************** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Configuration options gathered from: {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] ================================================================================ {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] allow_availability_zone_fallback = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] allow_compression_on_image_upload = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] allowed_direct_url_schemes = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86535]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] api_rate_limit = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] auth_strategy = keystone {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_availability_zone = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_host = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_stats_polling_interval = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backup_api_class = cinder.backup.api.API {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backup_name_template = backup-%s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backup_use_same_host = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backup_use_temp_snapshot = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] chap_password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] chap_username = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cinder_internal_tenant_project_id = 22602904548447b1b77b7f680113e41c {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cinder_internal_tenant_user_id = f804646ed97040cfb9c0a4328112fc41 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cluster = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] compression_format = gzip {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] compute_api_class = cinder.compute.nova.API {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] config_dir = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] config_source = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] control_exchange = openstack {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] debug = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] default_availability_zone = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] default_group_type = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] default_volume_type = QuobyteHD {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] disk_geometry = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] driver_client_cert = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] driver_client_cert_key = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] driver_data_namespace = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] driver_ssl_cert_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] driver_ssl_cert_verify = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] driver_use_ssl = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] enable_new_services = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] enable_unsupported_driver = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] enabled_backends = ['QuobyteHD'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] enforce_multipath_for_image_xfer = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] filter_function = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance_api_insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance_api_servers = ['http://192.168.122.10/image'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance_api_ssl_compression = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance_ca_certificates_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance_catalog_info = image:glance:publicURL {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance_certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance_keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance_num_retries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance_request_timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] goodness_function = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] graceful_shutdown_timeout = 5 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] group_api_class = cinder.group.api.API {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] host = devstack {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] image_compress_on_upload = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] image_conversion_address_space_limit = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] image_conversion_cpu_limit = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] image_conversion_disable = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] image_upload_use_cinder_backend = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] image_upload_use_internal_tenant = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] image_volume_cache_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] image_volume_cache_max_count = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] image_volume_cache_max_size_gb = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] init_host_max_objects_retrieval = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] instance_format = [instance: %(uuid)s] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] iscsi_target_flags = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] iscsi_write_cache = on {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] iser_helper = tgtadm {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] iser_ip_address = 192.168.122.10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] iser_port = 3260 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] log_color = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] log_config_append = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] log_dir = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] log_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] log_options = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86535]: INFO cinder.volume.manager [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Starting volume driver QuobyteDriver (1.2.1) Sep 04 05:53:23 devstack cinder-volume[86535]: DEBUG cinder.volume.drivers.remotefs [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86535) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] log_rotate_interval = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] log_rotate_interval_type = days {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] log_rotation_type = none {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] max_age = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] max_logfile_count = 30 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] max_logfile_size_mb = 200 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] max_over_subscription_ratio = 20.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] message_reap_interval = 86400 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] message_ttl = 2592000 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] migration_create_volume_timeout_secs = 300 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] monkey_patch = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] monkey_patch_modules = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] my_ip = 192.168.122.10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] no_snapshot_gb_quota = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] num_iser_scan_tries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] num_shell_tries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] num_volume_device_scan_tries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] nvmeof_conn_info_version = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] nvmet_ns_id = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] nvmet_port_id = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] osapi_max_limit = 1000 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] osapi_volume_ext_list = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:23 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] osapi_volume_listen = 0.0.0.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] osapi_volume_listen_port = 8776 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] osapi_volume_use_ssl = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] osapi_volume_workers = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] per_volume_size_limit = -1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] periodic_fuzzy_delay = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] periodic_interval = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] project_id_regex = [0-9a-f\-]+ {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] public_endpoint = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] publish_errors = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] quota_backup_gigabytes = 1000 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] quota_backups = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] quota_gigabytes = 1000 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] quota_groups = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] quota_snapshots = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] quota_volumes = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] rate_limit_burst = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] rate_limit_except_level = CRITICAL {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] rate_limit_interval = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] reinit_driver_count = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] replication_device = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] report_discard_supported = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] report_interval = 120 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] reservation_clean_interval = 86400 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] reservation_expire = 86400 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] reserved_image_namespaces = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] reserved_percentage = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] rpc_response_timeout = 120 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] run_external_periodic_tasks = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] scst_target_driver = iscsi {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] scst_target_iqn_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_down_time = 720 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] shell_completion = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] snapshot_name_template = snapshot-%s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] split_loggers = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] state_path = /opt/stack/data/cinder {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] storage_availability_zone = nova {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] storage_protocol = iSCSI {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] syslog_log_facility = LOG_USER {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] target_helper = lioadm {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] target_ip_address = 192.168.122.10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] target_port = 3260 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] target_protocol = iscsi {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] target_secondary_ip_addresses = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] trace_flags = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] transfer_api_class = cinder.transfer.api.API {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] transport_url = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] until_refresh = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] use_chap_auth = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] use_default_quota_class = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] use_journal = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] use_json = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] use_multipath_for_image_xfer = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] use_stderr = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] use_syslog = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] verify_glance_signatures = enabled {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volume_api_class = cinder.volume.api.API {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volume_backend_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volume_clear = zero {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volume_clear_ionice = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volume_clear_size = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volume_copy_bps_limit = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volume_dd_blocksize = 1M {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volume_name_template = volume-%s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volume_service_inithost_offload = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volume_usage_audit_period = month {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] zoning_mode = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_concurrency.disable_process_locking = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.auth_section = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.auth_type = password {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.auth_version = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.cache = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.include_service_catalog = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.interface = public {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcache_username = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.region_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.service_type = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.10/identity {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.backend = dogpile.cache.null {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.backend_argument = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.backend_expiration_time = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.config_prefix = cache.oslo {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.debug_cache_backend = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.enable_retry_client = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.enable_socket_keepalive = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.expiration_time = 600 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.hashclient_retry_attempts = 2 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.memcache_dead_retry = 300 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.memcache_pool_maxsize = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.memcache_sasl_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.proxies = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.redis_db = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.redis_server = localhost:6379 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.retry_attempts = 2 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.retry_delay = 0.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.socket_keepalive_count = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.socket_keepalive_idle = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.socket_keepalive_interval = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.socket_timeout = 1.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.tls_allowed_ciphers = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.tls_cafile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.tls_certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.tls_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.tls_keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cache.username = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] coordination.backend_url = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG cinder.volume.drivers.quobyte [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86535) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 04 05:53:24 devstack cinder-volume[86535]: WARNING cinder.volume.drivers.quobyte [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.asyncio_connection = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.asyncio_slave_connection = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86535]: WARNING cinder.volume.drivers.quobyte [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.backend = sqlalchemy {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.connection = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.connection_debug = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.connection_parameters = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.connection_recycle_time = 3600 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.connection_trace = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.db_inc_retry_interval = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG oslo_concurrency.processutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Running cmd (subprocess): mount.quobyte {{(pid=86535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.db_max_retries = 20 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.db_max_retry_interval = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.db_retry_interval = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.max_overflow = 50 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.max_pool_size = 5 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.max_retries = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.mysql_wsrep_sync_wait = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.pool_timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.retry_interval = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.slave_connection = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.sqlite_synchronous = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.synchronous_reader = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] database.use_db_reconnect = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_tracing.insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler.connection_string = messaging:// {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler.enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler.es_doc_type = notification {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler.es_scroll_size = 10000 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler.es_scroll_time = 2m {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler.filter_error_trace = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler.hmac_keys = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler.sentinel_service_name = mymaster {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler.socket_timeout = 0.1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler.trace_requests = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler.trace_sqlalchemy = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler_jaeger.process_tags = {} {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler_jaeger.service_name_prefix = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] profiler_otlp.service_name_prefix = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_policy.enforce_new_defaults = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_policy.policy_default_rule = default {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_policy.policy_file = policy.yaml {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_policy.remote_timeout = 60.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] privsep_osbrick.group = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] privsep_osbrick.helper_command = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] privsep_osbrick.user = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cinder_sys_admin.group = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cinder_sys_admin.helper_command = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] cinder_sys_admin.user = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_user.auth_section = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_user.auth_type = password {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_user.cafile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_user.certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_user.collect_timing = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_user.insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_user.keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_user.send_service_user_token = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_user.split_loggers = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_user.timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_user.tls_ciphers = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] service_user.tls_min_version = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance.auth_section = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance.auth_type = password {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance.certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance.collect_timing = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance.insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance.keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance.region_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance.split_loggers = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance.timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance.tls_ciphers = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] glance.tls_min_version = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.backend_availability_zone = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.chap_password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.chap_username = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.disk_geometry = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.driver_client_cert = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.driver_client_cert_key = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.driver_data_namespace = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.driver_use_ssl = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.extra_capabilities = {} {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.filter_function = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.goodness_function = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.iscsi_target_flags = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.iscsi_write_cache = on {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.iser_helper = tgtadm {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.iser_ip_address = 192.168.122.10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.iser_port = 3260 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nas_host = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nas_login = admin {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nas_mount_options = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nas_password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nas_private_key = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nas_share_path = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nas_ssh_port = 22 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.num_shell_tries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.quobyte_volume_url = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.replication_device = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.report_discard_supported = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.reserved_percentage = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.target_helper = tgtadm {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.target_ip_address = 192.168.122.10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.target_port = 3260 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.target_protocol = iscsi {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.trace_flags = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.unique_fqdn_network = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.use_chap_auth = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.volume_backend_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.volume_clear = zero {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.volume_clear_ionice = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.volume_clear_size = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_reports.file_event_handler = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_reports.log_dir = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.backend_availability_zone = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.backend_host = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.chap_password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.chap_username = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.chiscsi_conf = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.disk_geometry = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.driver_client_cert = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.driver_data_namespace = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.driver_use_ssl = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.extra_capabilities = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.filter_function = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.goodness_function = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.iscsi_target_flags = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.iscsi_write_cache = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.iser_helper = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.iser_ip_address = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.iser_port = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.iser_target_prefix = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nas_host = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nas_login = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nas_mount_options = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nas_password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nas_private_key = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nas_share_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nas_ssh_port = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.num_shell_tries = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nvmet_ns_id = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.nvmet_port_id = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.replication_device = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.report_discard_supported = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.reserved_percentage = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.scst_target_driver = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.storage_protocol = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.target_helper = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.target_ip_address = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.target_port = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.target_prefix = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.target_protocol = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.trace_flags = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.unique_fqdn_network = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.use_chap_auth = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.volume_clear = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.volume_clear_ionice = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.volume_clear_size = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] QuobyteHD.volumes_dir = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.ssl = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.ssl_version = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_notifications.driver = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_notifications.retry = -1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] key_manager.fixed_key = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.barbican_api_version = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.barbican_endpoint = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.barbican_endpoint_type = public {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.barbican_region_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.cafile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.collect_timing = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.number_of_retries = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.retry_delay = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.send_service_user_token = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.split_loggers = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.tls_ciphers = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.tls_min_version = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.verify_ssl = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican.verify_ssl_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican_service_user.auth_section = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican_service_user.auth_type = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican_service_user.cafile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican_service_user.certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican_service_user.collect_timing = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican_service_user.insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican_service_user.keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican_service_user.split_loggers = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican_service_user.timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican_service_user.tls_ciphers = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] barbican_service_user.tls_min_version = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.approle_role_id = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.approle_secret_id = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.auth_method = approle {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.auth_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.kv_mountpoint = secret {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.kv_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.kv_version = 2 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.namespace = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.root_token_id = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.ssl_ca_crt_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.timeout = 60.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.token_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.token_role = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.use_ssl = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:24 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] ******************************************************************************** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG oslo_concurrency.processutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] CMD "mount.quobyte" returned: 1 in 0.138s {{(pid=86535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG cinder.volume.drivers.quobyte [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=86535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:53:24 devstack cinder-volume[86535]: INFO cinder.volume.drivers.quobyte [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 ... Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG oslo_concurrency.processutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 -c /etc/quobyte/client-cinder.cfg {{(pid=86535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:53:24 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 -c /etc/quobyte/client-cinder.cfg Sep 04 05:53:24 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:53:24 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG oslo_concurrency.processutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.390s {{(pid=86535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:53:24 devstack cinder-volume[86535]: INFO cinder.volume.drivers.quobyte [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 succeeded Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG cinder.volume.drivers.quobyte [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=86535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.406s {{(pid=86535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG oslo_concurrency.processutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=86535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:53:24 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:53:24 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:53:24 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG oslo_concurrency.processutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.245s {{(pid=86535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:53:24 devstack cinder-volume[86535]: INFO cinder.volume.driver [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Driver hasn't implemented _init_vendor_properties() Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG cinder.volume.driver [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8068084716797, 'free_capacity_gb': 1773.8068084716797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86535) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 05:53:24 devstack cinder-volume[86535]: DEBUG oslo_db.sqlalchemy.engines [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86535) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG dbcounter [-] [86535] Writer thread running {{(pid=86535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG cinder.db.api [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Building query based on filter {{(pid=86535) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG cinder.image.image_utils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86535) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 05:53:25 devstack cinder-volume[86535]: INFO cinder.keymgr.migration [None req-0dc26787-1d05-4d86-85e4-bc02b96a0f0a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG cinder.volume.drivers.quobyte [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=86535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG cinder.volume.drivers.quobyte [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=86535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG oslo_concurrency.processutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=86535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:53:25 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:53:25 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:53:25 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG oslo_concurrency.processutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.232s {{(pid=86535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG cinder.manager [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Notifying Schedulers of capabilities ... {{(pid=86535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:53:25 devstack cinder-volume[86535]: INFO cinder.volume.manager [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Driver initialization completed successfully. Sep 04 05:53:25 devstack cinder-volume[86535]: INFO cinder.manager [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Initiating service 3 cleanup Sep 04 05:53:25 devstack cinder-volume[86535]: INFO cinder.manager [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Service 3 cleanup completed. Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG cinder.service [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Creating RPC server for service cinder-volume {{(pid=86535) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG cinder.service [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86535) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 05:53:25 devstack cinder-volume[86535]: INFO cinder.volume.manager [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG cinder.volume.drivers.quobyte [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=86535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG cinder.volume.drivers.quobyte [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=86535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG oslo_concurrency.processutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=86535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:53:25 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:53:25 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:53:25 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Sep 04 05:53:25 devstack cinder-volume[86535]: DEBUG oslo_concurrency.processutils [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.263s {{(pid=86535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:53:25 devstack cinder-volume[86535]: INFO cinder.volume.manager [None req-a8820bc0-8216-46d5-90d2-03cb65139dbe None None] Driver post RPC initialization completed successfully. Sep 04 05:53:30 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-14fb8fdf-a46f-4258-b3fc-fe325f21cbc3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:53:30 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-14fb8fdf-a46f-4258-b3fc-fe325f21cbc3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:53:30 devstack cinder-volume[86535]: DEBUG cinder.volume.drivers.quobyte [None req-14fb8fdf-a46f-4258-b3fc-fe325f21cbc3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=86535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:53:30 devstack cinder-volume[86535]: DEBUG cinder.volume.drivers.quobyte [None req-14fb8fdf-a46f-4258-b3fc-fe325f21cbc3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=86535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:53:30 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-14fb8fdf-a46f-4258-b3fc-fe325f21cbc3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:53:30 devstack cinder-volume[86535]: DEBUG oslo_concurrency.processutils [None req-14fb8fdf-a46f-4258-b3fc-fe325f21cbc3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=86535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:53:30 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:53:30 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:53:30 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Sep 04 05:53:30 devstack cinder-volume[86535]: DEBUG oslo_concurrency.processutils [None req-14fb8fdf-a46f-4258-b3fc-fe325f21cbc3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.226s {{(pid=86535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:53:30 devstack cinder-volume[86535]: DEBUG cinder.manager [None req-14fb8fdf-a46f-4258-b3fc-fe325f21cbc3 None None] Notifying Schedulers of capabilities ... {{(pid=86535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:53:33 devstack cinder-volume[86320]: INFO oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Caught SIGTERM, stopping children Sep 04 05:53:33 devstack cinder-volume[86320]: DEBUG oslo_concurrency.lockutils [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Acquiring lock "singleton_lock" {{(pid=86320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 05:53:33 devstack cinder-volume[86320]: DEBUG oslo_concurrency.lockutils [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Acquired lock "singleton_lock" {{(pid=86320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 05:53:33 devstack cinder-volume[86320]: DEBUG oslo_concurrency.lockutils [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Releasing lock "singleton_lock" {{(pid=86320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 05:53:33 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Stop services. {{(pid=86320) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 04 05:53:33 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Killing children. {{(pid=86320) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 04 05:53:33 devstack cinder-volume[86320]: INFO oslo_service.backend._eventlet.service [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Waiting on 1 children to exit Sep 04 05:53:35 devstack cinder-volume[86535]: DEBUG dbcounter [-] [86535] Writing DB stats cinder:SELECT=2 {{(pid=86535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:53:35 devstack cinder-volume[86535]: DEBUG dbcounter [-] [86535] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:53:38 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Acquiring lock "singleton_lock" {{(pid=86535) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 05:53:38 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Acquired lock "singleton_lock" {{(pid=86535) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 05:53:38 devstack cinder-volume[86535]: DEBUG oslo_concurrency.lockutils [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Releasing lock "singleton_lock" {{(pid=86535) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 05:53:38 devstack cinder-volume[86535]: WARNING amqp [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 05:53:38 devstack cinder-volume[86535]: WARNING amqp [None req-7723d2bd-f284-4a23-8a41-bba7962a4e4c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 05:53:39 devstack cinder-volume[86841]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 05:53:39 devstack cinder-volume[86841]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 05:53:39 devstack cinder-volume[86841]: we strongly recommend against using it for new projects. Sep 04 05:53:39 devstack cinder-volume[86841]: If you are already using Eventlet, we recommend migrating to a different Sep 04 05:53:39 devstack cinder-volume[86841]: framework. For more detail see Sep 04 05:53:39 devstack cinder-volume[86841]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 05:53:39 devstack cinder-volume[86841]: import eventlet # noqa Sep 04 05:53:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 05:53:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 05:53:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 05:53:42 devstack cinder-volume[86841]: INFO dbcounter [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] Registered counter for database cinder Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_db.sqlalchemy.engines [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writer thread running {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 05:53:42 devstack cinder-volume[86841]: INFO cinder.rpc [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 05:53:42 devstack cinder-volume[86841]: INFO cinder.rpc [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_db.sqlalchemy.engines [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:53:42 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] Determined volume DB was empty at startup. Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86841) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 05:53:42 devstack cinder-volume[86841]: WARNING stevedore.named [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 05:53:42 devstack cinder-volume[86841]: WARNING castellan.key_manager [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 05:53:42 devstack cinder-volume[86841]: WARNING cinder.keymgr.conf_key_mgr [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 05:53:42 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_db.sqlalchemy.engines [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:53:42 devstack cinder-volume[86841]: INFO oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] Starting 1 workers Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] Started child 87132 {{(pid=86841) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] Full set of CONF: {{(pid=86841) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] ******************************************************************************** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] Configuration options gathered from: {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] ================================================================================ {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] allow_availability_zone_fallback = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] allow_compression_on_image_upload = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] allowed_direct_url_schemes = [] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] api_rate_limit = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] auth_strategy = keystone {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_availability_zone = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_host = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_name = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_stats_polling_interval = 60 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backup_api_class = cinder.backup.api.API {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backup_name_template = backup-%s {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backup_use_same_host = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backup_use_temp_snapshot = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] chap_password = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] chap_username = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cinder_internal_tenant_project_id = 22602904548447b1b77b7f680113e41c {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cinder_internal_tenant_user_id = f804646ed97040cfb9c0a4328112fc41 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cluster = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[87132]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] compression_format = gzip {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] compute_api_class = cinder.compute.nova.API {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] config_dir = [] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] config_source = [] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] control_exchange = openstack {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] debug = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] default_availability_zone = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] default_group_type = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] default_volume_type = QuobyteHD {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] disk_geometry = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] driver_client_cert = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] driver_client_cert_key = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] driver_data_namespace = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] driver_ssl_cert_path = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] driver_ssl_cert_verify = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] driver_use_ssl = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] enable_new_services = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] enable_unsupported_driver = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] enabled_backends = ['QuobyteHD'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] enforce_multipath_for_image_xfer = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] filter_function = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance_api_insecure = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance_api_servers = ['http://192.168.122.10/image'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance_api_ssl_compression = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance_ca_certificates_file = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance_catalog_info = image:glance:publicURL {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance_certfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance_keyfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance_num_retries = 3 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance_request_timeout = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] goodness_function = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] graceful_shutdown_timeout = 5 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] group_api_class = cinder.group.api.API {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] host = devstack {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] image_compress_on_upload = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] image_conversion_address_space_limit = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] image_conversion_cpu_limit = 60 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] image_conversion_disable = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] image_upload_use_cinder_backend = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] image_upload_use_internal_tenant = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] image_volume_cache_enabled = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] image_volume_cache_max_count = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] image_volume_cache_max_size_gb = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:42 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] init_host_max_objects_retrieval = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] instance_format = [instance: %(uuid)s] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] iscsi_target_flags = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] iscsi_write_cache = on {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] iser_helper = tgtadm {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] iser_ip_address = 192.168.122.10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] iser_port = 3260 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] log_color = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] log_config_append = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] log_dir = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] log_file = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] log_options = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] log_rotate_interval = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] log_rotate_interval_type = days {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] log_rotation_type = none {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] max_age = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] max_logfile_count = 30 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] max_logfile_size_mb = 200 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] max_over_subscription_ratio = 20.0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] message_reap_interval = 86400 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] message_ttl = 2592000 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] migration_create_volume_timeout_secs = 300 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] monkey_patch = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] monkey_patch_modules = [] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] my_ip = 192.168.122.10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] no_snapshot_gb_quota = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] num_iser_scan_tries = 3 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] num_shell_tries = 3 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] num_volume_device_scan_tries = 3 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] nvmeof_conn_info_version = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] nvmet_ns_id = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] nvmet_port_id = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] osapi_max_limit = 1000 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] osapi_volume_ext_list = [] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] osapi_volume_listen_port = 8776 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] osapi_volume_use_ssl = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] osapi_volume_workers = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] per_volume_size_limit = -1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] periodic_fuzzy_delay = 60 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] periodic_interval = 60 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] public_endpoint = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] publish_errors = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] quota_backup_gigabytes = 1000 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] quota_backups = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] quota_gigabytes = 1000 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] quota_groups = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87132) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] quota_snapshots = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] quota_volumes = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] rate_limit_burst = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] rate_limit_except_level = CRITICAL {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] rate_limit_interval = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] reinit_driver_count = 3 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] replication_device = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] report_discard_supported = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] report_interval = 120 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] reservation_clean_interval = 86400 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] reservation_expire = 86400 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] reserved_image_namespaces = [] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] reserved_percentage = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] rpc_response_timeout = 120 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] run_external_periodic_tasks = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] scst_target_driver = iscsi {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] scst_target_iqn_name = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_down_time = 720 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] shell_completion = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] snapshot_name_template = snapshot-%s {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] split_loggers = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] state_path = /opt/stack/data/cinder {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] storage_availability_zone = nova {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] storage_protocol = iSCSI {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] syslog_log_facility = LOG_USER {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] target_helper = lioadm {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] target_ip_address = 192.168.122.10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] target_port = 3260 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] target_protocol = iscsi {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] target_secondary_ip_addresses = [] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] trace_flags = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] transport_url = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] until_refresh = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] use_chap_auth = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] use_default_quota_class = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] use_journal = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] use_json = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] use_multipath_for_image_xfer = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] use_stderr = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] use_syslog = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] verify_glance_signatures = enabled {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volume_api_class = cinder.volume.api.API {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volume_backend_name = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volume_clear = zero {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volume_clear_ionice = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volume_clear_size = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volume_copy_bps_limit = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volume_dd_blocksize = 1M {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volume_name_template = volume-%s {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volume_service_inithost_offload = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volume_usage_audit_period = month {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] zoning_mode = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_concurrency.disable_process_locking = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.auth_section = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.auth_type = password {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.auth_version = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.cache = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.certfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.include_service_catalog = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.insecure = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.interface = public {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.keyfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_password = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcache_username = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87132) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.region_name = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.service_type = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.10/identity {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.backend = dogpile.cache.null {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.backend_argument = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.backend_expiration_time = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.config_prefix = cache.oslo {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.debug_cache_backend = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.enable_retry_client = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.enable_socket_keepalive = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.quobyte [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.enabled = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.quobyte [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.expiration_time = 600 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.hashclient_retry_attempts = 2 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.memcache_dead_retry = 300 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Running cmd (subprocess): mount.quobyte {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.memcache_pool_maxsize = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.memcache_sasl_enabled = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.password = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.proxies = [] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.redis_db = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.redis_server = localhost:6379 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.retry_attempts = 2 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.retry_delay = 0.0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.socket_keepalive_count = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.socket_keepalive_idle = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.socket_keepalive_interval = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.socket_timeout = 1.0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.tls_allowed_ciphers = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.tls_cafile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.tls_certfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.tls_enabled = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.tls_keyfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cache.username = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] coordination.backend_url = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.asyncio_connection = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.asyncio_slave_connection = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.backend = sqlalchemy {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.connection = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.connection_debug = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.connection_parameters = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.connection_recycle_time = 3600 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.connection_trace = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.db_inc_retry_interval = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.db_max_retries = 20 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.db_max_retry_interval = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.db_retry_interval = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.max_overflow = 50 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.max_pool_size = 5 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.max_retries = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.mysql_wsrep_sync_wait = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.pool_timeout = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.retry_interval = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.slave_connection = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.sqlite_synchronous = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.synchronous_reader = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] database.use_db_reconnect = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_tracing.insecure = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler.connection_string = messaging:// {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler.enabled = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler.es_doc_type = notification {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler.es_scroll_size = 10000 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler.es_scroll_time = 2m {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler.filter_error_trace = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler.hmac_keys = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler.sentinel_service_name = mymaster {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler.socket_timeout = 0.1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler.trace_requests = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler.trace_sqlalchemy = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler_jaeger.process_tags = {} {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler_jaeger.service_name_prefix = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] profiler_otlp.service_name_prefix = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_policy.enforce_new_defaults = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_policy.policy_default_rule = default {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_policy.policy_file = policy.yaml {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] privsep_osbrick.group = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] privsep_osbrick.helper_command = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] privsep_osbrick.user = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cinder_sys_admin.group = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cinder_sys_admin.helper_command = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] cinder_sys_admin.user = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_user.auth_section = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_user.auth_type = password {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_user.cafile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_user.certfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_user.collect_timing = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_user.insecure = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_user.keyfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_user.send_service_user_token = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_user.split_loggers = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_user.timeout = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_user.tls_ciphers = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] service_user.tls_min_version = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack quobyte-client[87144]: Reading configuration file: /etc/quobyte/client.cfg Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance.auth_section = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance.auth_type = password {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance.certfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance.collect_timing = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance.insecure = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance.keyfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack quobyte-client[87144]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance.region_name = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance.split_loggers = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance.timeout = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance.tls_ciphers = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] glance.tls_min_version = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.backend_availability_zone = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.chap_password = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.chap_username = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.disk_geometry = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.driver_client_cert = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.driver_client_cert_key = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.driver_data_namespace = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.driver_use_ssl = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.extra_capabilities = {} {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.filter_function = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.goodness_function = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.iscsi_target_flags = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.iscsi_write_cache = on {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.iser_helper = tgtadm {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.iser_ip_address = 192.168.122.10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.iser_port = 3260 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nas_host = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nas_login = admin {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nas_mount_options = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nas_password = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nas_private_key = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nas_share_path = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.num_shell_tries = 3 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.quobyte_volume_url = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.replication_device = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.report_discard_supported = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.reserved_percentage = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.target_helper = tgtadm {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.target_ip_address = 192.168.122.10 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.target_port = 3260 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.target_protocol = iscsi {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.trace_flags = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.unique_fqdn_network = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.use_chap_auth = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.volume_backend_name = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.volume_clear = zero {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.volume_clear_ionice = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.volume_clear_size = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_reports.file_event_handler = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_reports.log_dir = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.backend_availability_zone = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.backend_host = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.chap_password = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.chap_username = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.chiscsi_conf = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.disk_geometry = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.driver_client_cert = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.driver_data_namespace = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.driver_use_ssl = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.extra_capabilities = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.filter_function = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.goodness_function = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.iser_helper = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.iser_ip_address = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.iser_port = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.iser_target_prefix = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nas_host = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nas_login = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nas_mount_options = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nas_password = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nas_private_key = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nas_share_path = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nas_ssh_port = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.num_shell_tries = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.nvmet_port_id = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.replication_device = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.report_discard_supported = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.reserved_percentage = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.scst_target_driver = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.storage_protocol = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.target_helper = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.target_ip_address = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.target_port = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.target_prefix = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.target_protocol = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.trace_flags = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.use_chap_auth = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.volume_clear = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.volume_clear_size = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] QuobyteHD.volumes_dir = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.ssl = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_notifications.driver = [] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_notifications.retry = -1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] key_manager.fixed_key = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.barbican_api_version = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.barbican_endpoint = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.barbican_endpoint_type = public {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.barbican_region_name = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.cafile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.certfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.collect_timing = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.insecure = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.keyfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.number_of_retries = 60 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.retry_delay = 1 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.send_service_user_token = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.split_loggers = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.timeout = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.tls_ciphers = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.tls_min_version = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.verify_ssl = True {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican.verify_ssl_path = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican_service_user.auth_section = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican_service_user.auth_type = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican_service_user.cafile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican_service_user.certfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican_service_user.collect_timing = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican_service_user.insecure = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican_service_user.keyfile = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican_service_user.split_loggers = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican_service_user.timeout = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican_service_user.tls_ciphers = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] barbican_service_user.tls_min_version = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.approle_role_id = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.approle_secret_id = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.auth_method = approle {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.auth_path = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.kv_mountpoint = secret {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.kv_path = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.kv_version = 2 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.namespace = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.root_token_id = **** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.ssl_ca_crt_file = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.timeout = 60.0 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.token_file = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.token_role = None {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.use_ssl = False {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 05:53:43 devstack cinder-volume[86841]: DEBUG oslo_service.backend._eventlet.service [None req-2d24b97d-a4f7-45fc-8b07-f02138e5e1a7 None None] ******************************************************************************** {{(pid=86841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 05:53:43 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:53:43 devstack cinder-volume[87132]: INFO cinder.volume.driver [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.volume.driver [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8068084716797, 'free_capacity_gb': 1773.8068084716797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87132) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_db.sqlalchemy.engines [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87132) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writer thread running {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.db.api [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Building query based on filter {{(pid=87132) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87132) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:53:43 devstack cinder-volume[87132]: INFO cinder.keymgr.migration [None req-926b9382-577b-4a63-bf85-b33bfaab3318 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 05:53:43 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:53:43 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:53:43 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.229s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:53:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Driver initialization completed successfully. Sep 04 05:53:43 devstack cinder-volume[87132]: INFO cinder.manager [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Initiating service 3 cleanup Sep 04 05:53:43 devstack cinder-volume[87132]: INFO cinder.manager [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Service 3 cleanup completed. Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.service [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Creating RPC server for service cinder-volume {{(pid=87132) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.service [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87132) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 05:53:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:53:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:53:43 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:53:43 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:53:44 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Sep 04 05:53:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:53:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-659f5a31-822c-4d23-99b7-70a1cd464db6 None None] Driver post RPC initialization completed successfully. Sep 04 05:53:52 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:53:53 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:53:54 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:54:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:54:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 6 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 05:54:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 05:54:57 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:54:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Flow 'volume_create_manager' (be3f0828-2f7a-4b5d-8f05-6ce135b5386a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:54:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f38a27d-4a1d-4276-8af4-e809442f5848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:54:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f38a27d-4a1d-4276-8af4-e809442f5848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-479837678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010dcba1-3f4d-467b-bd2f-e1995c6aa51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27669743eef40c8af3ff2b6bd6a946e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:54:57Z,use_quota=True,user_id='9cbddd2abf7b4e27be4d4b4f36a96dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:54:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4fa03dd-c3e3-464d-865f-d48601c6eae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:54:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4fa03dd-c3e3-464d-865f-d48601c6eae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:54:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf664a12-4f73-4fa4-a2f1-d4140e8604d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:54:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf664a12-4f73-4fa4-a2f1-d4140e8604d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010dcba1-3f4d-467b-bd2f-e1995c6aa51a', 'volume_name': 'volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1a6df3-977c-42c6-afcf-cab0d36f4df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1a6df3-977c-42c6-afcf-cab0d36f4df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec1c24e-b390-4592-a117-ce53ec755782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:54:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Volume 010dcba1-3f4d-467b-bd2f-e1995c6aa51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a', 'volume_size': 1} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-479837678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010dcba1-3f4d-467b-bd2f-e1995c6aa51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27669743eef40c8af3ff2b6bd6a946e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:54:57Z,use_quota=True,user_id='9cbddd2abf7b4e27be4d4b4f36a96dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Creating volume 010dcba1-3f4d-467b-bd2f-e1995c6aa51a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:54:58 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:54:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:54:58 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a 1073741824 Sep 04 05:54:58 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:00 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a 1073741824" returned: 0 in 1.816s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:55:00 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a Sep 04 05:55:00 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:00 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a" returned: 0 in 0.519s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] <== create_volume: return (2528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:55:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.550s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:55:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec1c24e-b390-4592-a117-ce53ec755782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a52786-e3bf-4b71-9bab-d36b7319302b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Volume volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a (010dcba1-3f4d-467b-bd2f-e1995c6aa51a): created successfully Sep 04 05:55:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a52786-e3bf-4b71-9bab-d36b7319302b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Flow 'volume_create_manager' (be3f0828-2f7a-4b5d-8f05-6ce135b5386a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:55:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-794ff065-4b29-4d8b-8753-af3c9dcb7d86 tempest-DeleteServersTestJSON-442042546 None] Created volume successfully. Sep 04 05:55:02 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:55:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Flow 'volume_create_manager' (30fa768e-3062-4068-ae62-8045d7c706af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:55:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3c391d-728d-4970-9785-f3c887b43b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3c391d-728d-4970-9785-f3c887b43b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1513361214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba984970-51bd-411a-a07b-9d7cdd326445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391b5fc15f44443da0a59f7b4ac2708f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:55:03Z,use_quota=True,user_id='6bb25f1abbb2444e92f3c9afbc9e5cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4ed8f8-bd9b-4d4b-81bb-a13eb17376ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4ed8f8-bd9b-4d4b-81bb-a13eb17376ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c1ed94-55f2-41eb-a5c0-577007a02e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c1ed94-55f2-41eb-a5c0-577007a02e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba984970-51bd-411a-a07b-9d7cdd326445', 'volume_name': 'volume-ba984970-51bd-411a-a07b-9d7cdd326445', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a1d965-6cb7-44d6-ba9a-c8aa62b57171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a1d965-6cb7-44d6-ba9a-c8aa62b57171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13f133b-344b-40c1-9823-490c9dfc2983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Volume ba984970-51bd-411a-a07b-9d7cdd326445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba984970-51bd-411a-a07b-9d7cdd326445', 'volume_size': 1} Sep 04 05:55:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:55:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:55:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1513361214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba984970-51bd-411a-a07b-9d7cdd326445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391b5fc15f44443da0a59f7b4ac2708f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:55:03Z,use_quota=True,user_id='6bb25f1abbb2444e92f3c9afbc9e5cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:55:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Creating volume ba984970-51bd-411a-a07b-9d7cdd326445 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:55:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:55:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:55:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:55:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:55:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:55:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:55:03 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:55:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba984970-51bd-411a-a07b-9d7cdd326445 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:55:03 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba984970-51bd-411a-a07b-9d7cdd326445 1073741824 Sep 04 05:55:03 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:04 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba984970-51bd-411a-a07b-9d7cdd326445 1073741824" returned: 0 in 1.049s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba984970-51bd-411a-a07b-9d7cdd326445 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:55:04 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba984970-51bd-411a-a07b-9d7cdd326445 Sep 04 05:55:04 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:04 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba984970-51bd-411a-a07b-9d7cdd326445" returned: 0 in 0.462s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:55:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:55:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13f133b-344b-40c1-9823-490c9dfc2983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba984970-51bd-411a-a07b-9d7cdd326445', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfa7913-d6ff-4c93-9b1e-984c7f0a788c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Volume volume-ba984970-51bd-411a-a07b-9d7cdd326445 (ba984970-51bd-411a-a07b-9d7cdd326445): created successfully Sep 04 05:55:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfa7913-d6ff-4c93-9b1e-984c7f0a788c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Flow 'volume_create_manager' (30fa768e-3062-4068-ae62-8045d7c706af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:55:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c89ec532-448e-4f95-b4a2-94f90027ad69 tempest-VolumesAdminNegativeTest-1279263734 None] Created volume successfully. Sep 04 05:55:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Acquiring lock "cinder-ba984970-51bd-411a-a07b-9d7cdd326445-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:55:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Lock "cinder-ba984970-51bd-411a-a07b-9d7cdd326445-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:55:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Acquiring lock "cinder-quobyte-ba984970-51bd-411a-a07b-9d7cdd326445" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:55:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Lock "cinder-quobyte-ba984970-51bd-411a-a07b-9d7cdd326445" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:55:06 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpz3ykfm2t/privsep.sock'] Sep 04 05:55:06 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpz3ykfm2t/privsep.sock Sep 04 05:55:06 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:06 devstack cinder-volume[87132]: WARNING py.warnings [req-2e45067a-0c83-424a-b5e4-bdd0740dfbd8 req-607f9e52-e645-4245-8fbe-95e80d6debfe tempest-DeleteServersTestJSON-442042546 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 04 05:55:06 devstack cinder-volume[87132]: .first() Sep 04 05:55:06 devstack cinder-volume[87132]: Sep 04 05:55:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-2e45067a-0c83-424a-b5e4-bdd0740dfbd8 req-607f9e52-e645-4245-8fbe-95e80d6debfe tempest-DeleteServersTestJSON-442042546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:55:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-2e45067a-0c83-424a-b5e4-bdd0740dfbd8 req-607f9e52-e645-4245-8fbe-95e80d6debfe tempest-DeleteServersTestJSON-442042546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:55:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-2e45067a-0c83-424a-b5e4-bdd0740dfbd8 req-607f9e52-e645-4245-8fbe-95e80d6debfe tempest-DeleteServersTestJSON-442042546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:55:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2e45067a-0c83-424a-b5e4-bdd0740dfbd8 req-607f9e52-e645-4245-8fbe-95e80d6debfe tempest-DeleteServersTestJSON-442042546 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea33d219-8404-4715-9eee-2b16ec5472f0', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 05:55:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-2e45067a-0c83-424a-b5e4-bdd0740dfbd8 req-607f9e52-e645-4245-8fbe-95e80d6debfe tempest-DeleteServersTestJSON-442042546 None] attachment_update completed successfully. Sep 04 05:55:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 04 05:55:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 05:55:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 04 05:55:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: Sep 04 05:55:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 04 05:55:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 04 05:55:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 05:55:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: Sep 04 05:55:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 04 05:55:09 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:09 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Spawned new privsep daemon via rootwrap Sep 04 05:55:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Accepted privsep connection to /tmp/tmpz3ykfm2t/privsep.sock {{(pid=87132) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 04 05:55:09 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 04 05:55:09 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 04 05:55:09 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 04 05:55:09 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89022 Sep 04 05:55:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c72f645-e19f-463a-9819-4bb8d0fcbcd1]: (2,) {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:55:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb25441-a64d-452b-9fd9-dff7a076999a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:55:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba984970-51bd-411a-a07b-9d7cdd326445 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:55:10 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba984970-51bd-411a-a07b-9d7cdd326445 Sep 04 05:55:10 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:10 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba984970-51bd-411a-a07b-9d7cdd326445" returned: 0 in 0.920s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba984970-51bd-411a-a07b-9d7cdd326445 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:55:10 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba984970-51bd-411a-a07b-9d7cdd326445 Sep 04 05:55:10 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:12 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba984970-51bd-411a-a07b-9d7cdd326445" returned: 0 in 1.218s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Lock "cinder-quobyte-ba984970-51bd-411a-a07b-9d7cdd326445" released by "delete_volume" :: held 5.360s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:55:12 devstack cinder-volume[87132]: WARNING cinder.quota [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:55:12 devstack cinder-volume[87132]: WARNING cinder.quota [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:55:12 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Created reservations ['028d5d45-3794-4a9f-9522-4eb13756f328', 'ccb168dd-e3a5-44cc-9142-81e6fa4e7e79', '2571f20d-6797-47b6-a52a-afbf200ff56b', '34c0ad99-2ae5-48fb-8e38-4e5d2edfe9e6'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:55:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:55:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:55:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:55:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:55:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:55:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:55:12 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:55:12 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:13 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.597s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:13 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:55:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Deleted volume successfully. Sep 04 05:55:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6858d18c-52e9-47c6-b51a-dde4d632250e tempest-VolumesAdminNegativeTest-1279263734 None] Lock "cinder-ba984970-51bd-411a-a07b-9d7cdd326445-delete_volume" released by "delete_volume" :: held 6.799s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:55:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-cfc7fae1-43f7-4c97-85bc-f6f7362bb265 req-d3da60be-68cc-471d-8818-4cc318377796 tempest-DeleteServersTestJSON-442042546 None] Terminate volume connection completed successfully. Sep 04 05:55:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-cfc7fae1-43f7-4c97-85bc-f6f7362bb265 req-d3da60be-68cc-471d-8818-4cc318377796 tempest-DeleteServersTestJSON-442042546 None] Deleting attachment ea33d219-8404-4715-9eee-2b16ec5472f0. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 05:55:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Acquiring lock "cinder-010dcba1-3f4d-467b-bd2f-e1995c6aa51a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:55:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Lock "cinder-010dcba1-3f4d-467b-bd2f-e1995c6aa51a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:55:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Acquiring lock "cinder-quobyte-010dcba1-3f4d-467b-bd2f-e1995c6aa51a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:55:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Lock "cinder-quobyte-010dcba1-3f4d-467b-bd2f-e1995c6aa51a" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:55:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3137327-34a6-451e-b60c-ea4ee0643b2a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:55:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:55:15 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a Sep 04 05:55:15 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:15 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a" returned: 0 in 0.507s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:55:16 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a Sep 04 05:55:16 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:16 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-010dcba1-3f4d-467b-bd2f-e1995c6aa51a" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Lock "cinder-quobyte-010dcba1-3f4d-467b-bd2f-e1995c6aa51a" released by "delete_volume" :: held 0.869s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:55:16 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Created reservations ['c5bc0984-af5f-417a-a888-7f47cd10bef0', 'c164215c-5171-45e1-97f3-b47fee6e87ed', 'c1c62ac8-23bf-48b9-9744-31122f0523d7', 'd9379023-ba28-4b8b-897c-5678953e46a7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:55:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:55:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:55:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:55:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:55:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:55:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:55:16 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:55:16 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:16 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:16 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:55:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Deleted volume successfully. Sep 04 05:55:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0724d04-1477-41ad-84af-881f87d3b6e7 tempest-DeleteServersTestJSON-442042546 None] Lock "cinder-010dcba1-3f4d-467b-bd2f-e1995c6aa51a-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:55:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:55:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:55:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:55:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:55:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:55:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:55:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:55:25 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:55:25 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:25 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.323s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:55:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:55:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 8 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 05:55:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 05:55:26 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=24,cinder:SELECT=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:55:26 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=21,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Flow 'volume_create_manager' (884d00b6-67d6-4796-9eac-1c97cbfc4f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c507c4-6a1d-417a-ba91-e10987789262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c507c4-6a1d-417a-ba91-e10987789262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-199122421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3f279c-b9a3-4df5-ab17-b48dfa895f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38dda44298664054a5dc8db4731ac3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:55:36Z,use_quota=True,user_id='764ca0d7d3b14691965c7c4c57854944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d25836f-6a34-40ca-bd6b-d592633baafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d25836f-6a34-40ca-bd6b-d592633baafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3b7fce-1bfe-4390-a171-62b75d4a4267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3b7fce-1bfe-4390-a171-62b75d4a4267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df3f279c-b9a3-4df5-ab17-b48dfa895f24', 'volume_name': 'volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27092cd8-4c6b-488d-8e2f-0a2ba42db297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27092cd8-4c6b-488d-8e2f-0a2ba42db297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d0d6ce-dd3d-4f28-ae51-9fc7fe3107be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Volume df3f279c-b9a3-4df5-ab17-b48dfa895f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24', 'volume_size': 1} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-199122421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3f279c-b9a3-4df5-ab17-b48dfa895f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38dda44298664054a5dc8db4731ac3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:55:36Z,use_quota=True,user_id='764ca0d7d3b14691965c7c4c57854944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Creating volume df3f279c-b9a3-4df5-ab17-b48dfa895f24 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:55:36 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:55:36 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24 1073741824 Sep 04 05:55:36 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:36 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24 1073741824" returned: 0 in 0.549s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:55:36 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24 Sep 04 05:55:36 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:55:37 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Sep 04 05:55:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24" returned: 0 in 0.355s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:55:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:55:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:55:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d0d6ce-dd3d-4f28-ae51-9fc7fe3107be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dea7a4c-6d8d-42af-8fb2-2017df0fcef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:55:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Volume volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24 (df3f279c-b9a3-4df5-ab17-b48dfa895f24): created successfully Sep 04 05:55:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dea7a4c-6d8d-42af-8fb2-2017df0fcef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:55:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Flow 'volume_create_manager' (884d00b6-67d6-4796-9eac-1c97cbfc4f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:55:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bcc62a5a-ad77-44f3-881c-7348dfc070d4 tempest-ServerActionsTestOtherA-696632990 None] Created volume successfully. Sep 04 05:55:54 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4,cinder:INSERT=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:55:54 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:56:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:56:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:56:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:56:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:56:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:56:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:56:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:56:25 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:56:25 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:56:25 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Sep 04 05:56:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.462s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:56:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Flow 'volume_create_manager' (0a9a8626-efb4-4ae2-a2e7-f00ad9cc6bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab77e868-f9ec-42c9-a349-cb0b877e1cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab77e868-f9ec-42c9-a349-cb0b877e1cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-926450985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac07a59-c718-4549-b3c3-134c7277edde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d4acde81c4586af88a1f71c4c0a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:56:28Z,use_quota=True,user_id='20581eed759b4236a794641ef41ff354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099f808d-0a0d-474e-abcd-82c9c0e62681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099f808d-0a0d-474e-abcd-82c9c0e62681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49d094d-d303-4867-b165-2f8a7db8dd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49d094d-d303-4867-b165-2f8a7db8dd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac07a59-c718-4549-b3c3-134c7277edde', 'volume_name': 'volume-4ac07a59-c718-4549-b3c3-134c7277edde', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e7100b-80a9-4918-9448-2f9f0b55a7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e7100b-80a9-4918-9448-2f9f0b55a7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e3b79e-e9d7-4ef6-a924-b385ce6c36b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Volume 4ac07a59-c718-4549-b3c3-134c7277edde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac07a59-c718-4549-b3c3-134c7277edde', 'volume_size': 1} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-926450985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac07a59-c718-4549-b3c3-134c7277edde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d4acde81c4586af88a1f71c4c0a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:56:28Z,use_quota=True,user_id='20581eed759b4236a794641ef41ff354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Creating volume 4ac07a59-c718-4549-b3c3-134c7277edde {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:56:28 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac07a59-c718-4549-b3c3-134c7277edde 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:56:28 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac07a59-c718-4549-b3c3-134c7277edde 1073741824 Sep 04 05:56:28 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:56:28 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Sep 04 05:56:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac07a59-c718-4549-b3c3-134c7277edde 1073741824" returned: 0 in 0.560s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:56:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac07a59-c718-4549-b3c3-134c7277edde {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:56:29 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac07a59-c718-4549-b3c3-134c7277edde Sep 04 05:56:29 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:56:29 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Sep 04 05:56:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac07a59-c718-4549-b3c3-134c7277edde" returned: 0 in 0.451s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:56:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:56:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:56:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e3b79e-e9d7-4ef6-a924-b385ce6c36b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac07a59-c718-4549-b3c3-134c7277edde', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f185e3-c80d-4f53-9d91-db4ca8112485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Volume volume-4ac07a59-c718-4549-b3c3-134c7277edde (4ac07a59-c718-4549-b3c3-134c7277edde): created successfully Sep 04 05:56:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f185e3-c80d-4f53-9d91-db4ca8112485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Flow 'volume_create_manager' (0a9a8626-efb4-4ae2-a2e7-f00ad9cc6bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:56:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6fdc7c55-7d36-482e-9625-8fb839e69ab0 tempest-ServerRescueNegativeTestJSON-1282410787 None] Created volume successfully. Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Flow 'volume_create_manager' (0d9b09b5-d70e-4c6a-907c-0273e9a3b310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc2b3f4-1b56-4936-a524-25d62b28133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc2b3f4-1b56-4936-a524-25d62b28133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1607906063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c99980-017b-4088-827b-0b96d4ac3011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af879bbde8420ca107cddcd54c1b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:56:31Z,use_quota=True,user_id='1b2ade367fb04260b5c60be0db965494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e789f74-23db-4c34-bdbc-c2641f7f8b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e789f74-23db-4c34-bdbc-c2641f7f8b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9015622a-fe1d-4435-90d3-47b3d6f5f6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9015622a-fe1d-4435-90d3-47b3d6f5f6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c99980-017b-4088-827b-0b96d4ac3011', 'volume_name': 'volume-77c99980-017b-4088-827b-0b96d4ac3011', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ddb7c8-2260-4215-9a05-549308858091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ddb7c8-2260-4215-9a05-549308858091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61608b6f-3590-42e8-abc2-80e4acd6464f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Volume 77c99980-017b-4088-827b-0b96d4ac3011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c99980-017b-4088-827b-0b96d4ac3011', 'volume_size': 1} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1607906063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c99980-017b-4088-827b-0b96d4ac3011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af879bbde8420ca107cddcd54c1b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:56:31Z,use_quota=True,user_id='1b2ade367fb04260b5c60be0db965494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Creating volume 77c99980-017b-4088-827b-0b96d4ac3011 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:56:31 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:56:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-77c99980-017b-4088-827b-0b96d4ac3011 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:56:31 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-77c99980-017b-4088-827b-0b96d4ac3011 1073741824 Sep 04 05:56:31 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:56:32 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Sep 04 05:56:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-77c99980-017b-4088-827b-0b96d4ac3011 1073741824" returned: 0 in 0.689s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:56:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-77c99980-017b-4088-827b-0b96d4ac3011 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:56:32 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-77c99980-017b-4088-827b-0b96d4ac3011 Sep 04 05:56:32 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:56:32 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Sep 04 05:56:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-77c99980-017b-4088-827b-0b96d4ac3011" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:56:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:56:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:56:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61608b6f-3590-42e8-abc2-80e4acd6464f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c99980-017b-4088-827b-0b96d4ac3011', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559a1acd-dc07-46c4-bf3d-4a9108a55440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Volume volume-77c99980-017b-4088-827b-0b96d4ac3011 (77c99980-017b-4088-827b-0b96d4ac3011): created successfully Sep 04 05:56:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559a1acd-dc07-46c4-bf3d-4a9108a55440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Flow 'volume_create_manager' (0d9b09b5-d70e-4c6a-907c-0273e9a3b310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:56:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8b54b1eb-c445-46ba-80eb-61dc0ac21deb tempest-TaggedAttachmentsTest-256430779 None] Created volume successfully. Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Flow 'volume_create_manager' (028a6c1a-2a38-4188-9af2-d5e373a6d74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01963d1-6839-4b23-bb3d-7ecd997556f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01963d1-6839-4b23-bb3d-7ecd997556f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1455913918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467b27d185a42488f7e4e55a7a2490f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:56:36Z,use_quota=True,user_id='2cb7c4d66b714232b38438ffa9edbc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44191355-34ae-4a4a-85bf-0911dd023fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44191355-34ae-4a4a-85bf-0911dd023fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3340d1f1-b0c0-4607-8a0e-3e063c4d4b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3340d1f1-b0c0-4607-8a0e-3e063c4d4b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f', 'volume_name': 'volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b054e6f-37da-4a19-9635-5184e7180085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b054e6f-37da-4a19-9635-5184e7180085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f79d4c-ab85-42ff-9c5c-a441a9134801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Volume bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f', 'volume_size': 1} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1455913918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467b27d185a42488f7e4e55a7a2490f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:56:36Z,use_quota=True,user_id='2cb7c4d66b714232b38438ffa9edbc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Creating volume bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:56:35 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:56:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:56:35 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f 1073741824 Sep 04 05:56:35 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:56:37 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Sep 04 05:56:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f 1073741824" returned: 0 in 1.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:56:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:56:37 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f Sep 04 05:56:37 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:56:37 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Sep 04 05:56:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f" returned: 0 in 0.660s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:56:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:56:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:56:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f79d4c-ab85-42ff-9c5c-a441a9134801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e328b1d-992a-44f8-9a8b-cc3c7527a427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:56:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Volume volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f (bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f): created successfully Sep 04 05:56:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e328b1d-992a-44f8-9a8b-cc3c7527a427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:56:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Flow 'volume_create_manager' (028a6c1a-2a38-4188-9af2-d5e373a6d74b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:56:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-46189dd9-ea90-457d-a9ca-ce23e02e0670 tempest-AttachVolumeShelveTestJSON-1114145371 None] Created volume successfully. Sep 04 05:56:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-302c1b39-884e-4da1-9c48-2b738448fde2 req-241caa70-2daf-43b4-aa2e-c107c4fa6fde tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:56:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-302c1b39-884e-4da1-9c48-2b738448fde2 req-241caa70-2daf-43b4-aa2e-c107c4fa6fde tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:56:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-302c1b39-884e-4da1-9c48-2b738448fde2 req-241caa70-2daf-43b4-aa2e-c107c4fa6fde tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:56:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-302c1b39-884e-4da1-9c48-2b738448fde2 req-241caa70-2daf-43b4-aa2e-c107c4fa6fde tempest-ServerActionsTestOtherA-696632990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29da37d1-71d7-48f8-9bcf-061b04b0562b', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 05:56:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-302c1b39-884e-4da1-9c48-2b738448fde2 req-241caa70-2daf-43b4-aa2e-c107c4fa6fde tempest-ServerActionsTestOtherA-696632990 None] attachment_update completed successfully. Sep 04 05:56:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Acquiring lock "cinder-4ac07a59-c718-4549-b3c3-134c7277edde-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:56:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Lock "cinder-4ac07a59-c718-4549-b3c3-134c7277edde-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:56:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Acquiring lock "cinder-quobyte-4ac07a59-c718-4549-b3c3-134c7277edde" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:56:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Lock "cinder-quobyte-4ac07a59-c718-4549-b3c3-134c7277edde" acquired by "delete_volume" :: waited 0.073s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:56:43 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b896553-4687-4ae4-ad56-f3e5273b9744]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:56:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac07a59-c718-4549-b3c3-134c7277edde {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:56:44 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac07a59-c718-4549-b3c3-134c7277edde Sep 04 05:56:44 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:56:44 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Sep 04 05:56:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac07a59-c718-4549-b3c3-134c7277edde" returned: 0 in 0.994s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:56:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac07a59-c718-4549-b3c3-134c7277edde {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:56:44 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac07a59-c718-4549-b3c3-134c7277edde Sep 04 05:56:44 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:56:45 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Sep 04 05:56:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac07a59-c718-4549-b3c3-134c7277edde" returned: 0 in 0.562s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:56:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Lock "cinder-quobyte-4ac07a59-c718-4549-b3c3-134c7277edde" released by "delete_volume" :: held 1.654s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:56:45 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Created reservations ['343fb71e-3af2-4724-b5ba-1ca88e469c5e', '8f0cd83b-6fdd-4f7c-b760-0d94fab275b6', '38ca36fc-4151-4362-805e-40d839a15f60', '4ea36ae0-cf6f-4f26-a8fd-5e6b1096de4e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:56:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:56:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:56:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:56:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:56:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:56:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:56:45 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:56:45 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:56:46 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Sep 04 05:56:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.780s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:56:46 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:56:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Deleted volume successfully. Sep 04 05:56:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c78463c-78ad-4270-9858-88d062d97b04 tempest-ServerRescueNegativeTestJSON-1282410787 None] Lock "cinder-4ac07a59-c718-4549-b3c3-134c7277edde-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:56:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-c4498abb-1ac4-4160-9a19-2c4fa6d4e2e2 req-a96071eb-2ccd-4f7f-916b-6e34015960fc tempest-ServerActionsTestOtherA-696632990 None] Terminate volume connection completed successfully. Sep 04 05:56:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-c4498abb-1ac4-4160-9a19-2c4fa6d4e2e2 req-a96071eb-2ccd-4f7f-916b-6e34015960fc tempest-ServerActionsTestOtherA-696632990 None] Deleting attachment 29da37d1-71d7-48f8-9bcf-061b04b0562b. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 05:56:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c4498abb-1ac4-4160-9a19-2c4fa6d4e2e2 req-a798fe53-9cbd-4910-ba5f-6ea679ef34c9 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:56:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c4498abb-1ac4-4160-9a19-2c4fa6d4e2e2 req-a798fe53-9cbd-4910-ba5f-6ea679ef34c9 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:56:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c4498abb-1ac4-4160-9a19-2c4fa6d4e2e2 req-a798fe53-9cbd-4910-ba5f-6ea679ef34c9 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:56:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-c4498abb-1ac4-4160-9a19-2c4fa6d4e2e2 req-a798fe53-9cbd-4910-ba5f-6ea679ef34c9 tempest-ServerActionsTestOtherA-696632990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '223fc25b-293d-4257-bdcb-565a499922c7', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 05:56:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-c4498abb-1ac4-4160-9a19-2c4fa6d4e2e2 req-a798fe53-9cbd-4910-ba5f-6ea679ef34c9 tempest-ServerActionsTestOtherA-696632990 None] attachment_update completed successfully. Sep 04 05:57:00 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=26,cinder:INSERT=4,cinder:UPDATE=17,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:57:00 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=23,cinder:SELECT=24,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:57:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-bb9feff6-a3d7-41ce-8700-fe24daf27aab req-b30bd2c1-4514-40a2-b952-dfe028ef193a tempest-AttachVolumeShelveTestJSON-1114145371 None] No connector for attachment 21cc3629-ce54-4162-8118-063d99e1199a; skipping storage backend terminate_connection call. {{(pid=87132) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 04 05:57:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-bb9feff6-a3d7-41ce-8700-fe24daf27aab req-b30bd2c1-4514-40a2-b952-dfe028ef193a tempest-AttachVolumeShelveTestJSON-1114145371 None] Deleting attachment 21cc3629-ce54-4162-8118-063d99e1199a. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 05:57:12 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:57:12 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:57:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:57:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:57:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:57:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:57:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:57:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:57:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:25 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:57:25 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:25 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:57:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:57:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 8 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 05:57:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 05:57:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-21002841-f01f-4bb7-a502-1288ba949e24 req-da2864cb-3f08-4003-b527-997f90064579 tempest-ServerActionsTestOtherA-696632990 None] Terminate volume connection completed successfully. Sep 04 05:57:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-21002841-f01f-4bb7-a502-1288ba949e24 req-da2864cb-3f08-4003-b527-997f90064579 tempest-ServerActionsTestOtherA-696632990 None] Deleting attachment 223fc25b-293d-4257-bdcb-565a499922c7. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 05:57:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-7403fca0-b282-4676-aea2-67030e86607d req-46b5793e-2745-4678-ad09-0faebfed018d tempest-TaggedAttachmentsTest-256430779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:57:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-7403fca0-b282-4676-aea2-67030e86607d req-46b5793e-2745-4678-ad09-0faebfed018d tempest-TaggedAttachmentsTest-256430779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:57:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-7403fca0-b282-4676-aea2-67030e86607d req-46b5793e-2745-4678-ad09-0faebfed018d tempest-TaggedAttachmentsTest-256430779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:57:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-7403fca0-b282-4676-aea2-67030e86607d req-46b5793e-2745-4678-ad09-0faebfed018d tempest-TaggedAttachmentsTest-256430779 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-77c99980-017b-4088-827b-0b96d4ac3011', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f586e9bc-664f-4c2c-900e-aa2321e6860f', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 05:57:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-7403fca0-b282-4676-aea2-67030e86607d req-46b5793e-2745-4678-ad09-0faebfed018d tempest-TaggedAttachmentsTest-256430779 None] attachment_update completed successfully. Sep 04 05:57:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-4c4265ee-fb69-44ae-8efb-7666c0f5d8a7 req-dbb83697-a299-475f-970d-c9d96713502a tempest-TaggedAttachmentsTest-256430779 None] Terminate volume connection completed successfully. Sep 04 05:57:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-4c4265ee-fb69-44ae-8efb-7666c0f5d8a7 req-dbb83697-a299-475f-970d-c9d96713502a tempest-TaggedAttachmentsTest-256430779 None] Deleting attachment f586e9bc-664f-4c2c-900e-aa2321e6860f. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 05:57:36 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:57:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Flow 'volume_create_manager' (ae5b8a7f-04ba-4313-bfd1-76795e45e3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:57:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d26bd4d-f936-4475-b857-c5e88b48ae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:57:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d26bd4d-f936-4475-b857-c5e88b48ae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-278141766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea51c95c-0e3e-4344-bc22-7537248497f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38dda44298664054a5dc8db4731ac3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:37Z,use_quota=True,user_id='764ca0d7d3b14691965c7c4c57854944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:57:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b0c3a0-5c2e-49c6-ac39-60c60a1d103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:57:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b0c3a0-5c2e-49c6-ac39-60c60a1d103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:57:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54196b38-062b-46e2-803c-5e46329f7fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:57:37 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 05:57:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54196b38-062b-46e2-803c-5e46329f7fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ea51c95c-0e3e-4344-bc22-7537248497f7', 'volume_name': 'volume-ea51c95c-0e3e-4344-bc22-7537248497f7', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:57:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38972376-5d0a-44fa-a35b-0aafe4f84e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:57:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38972376-5d0a-44fa-a35b-0aafe4f84e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:57:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a769e55-3a54-4ce0-833e-84fad910cbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:57:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Volume ea51c95c-0e3e-4344-bc22-7537248497f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ea51c95c-0e3e-4344-bc22-7537248497f7', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 05:57:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Trying to clone ea51c95c-0e3e-4344-bc22-7537248497f7 from image e49bac44-c124-47bb-b839-5895be946aa9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 05:57:38 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 05:57:38 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Image download 20.69 MB at 20.69 MB/s Sep 04 05:57:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4167c2f3-1133-4af7-91b8-7aaa629eb177]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:57:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:39 devstack sudo[91956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD Sep 04 05:57:39 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:39 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD" returned: 0 in 0.534s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:39 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Temporary image e49bac44-c124-47bb-b839-5895be946aa9 is fetched for user 764ca0d7d3b14691965c7c4c57854944. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 05:57:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d17dd23-0707-47e6-a3c8-b10f244d0387]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:57:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:39 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD Sep 04 05:57:39 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:40 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-278141766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea51c95c-0e3e-4344-bc22-7537248497f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38dda44298664054a5dc8db4731ac3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:37Z,use_quota=True,user_id='764ca0d7d3b14691965c7c4c57854944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Creating volume ea51c95c-0e3e-4344-bc22-7537248497f7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:57:40 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:40 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 1073741824 Sep 04 05:57:40 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:40 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 1073741824" returned: 0 in 0.710s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:40 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 Sep 04 05:57:40 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:41 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7" returned: 0 in 0.643s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:57:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:57:41 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Attempting download of e49bac44-c124-47bb-b839-5895be946aa9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}])) to volume ea51c95c-0e3e-4344-bc22-7537248497f7. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 05:57:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f45b43-e1f8-403a-9719-c04dc6e0f350]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:57:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_u231rr6a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:41 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_u231rr6a Sep 04 05:57:41 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:41 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_u231rr6a" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_u231rr6a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:42 devstack sudo[92005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_u231rr6a Sep 04 05:57:42 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:42 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_u231rr6a" returned: 1 in 0.543s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_u231rr6a' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 05:57:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[db80f8d9-57d4-40ee-9a34-ee4467d1f8f6]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:57:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:42 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD Sep 04 05:57:42 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:42 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD" returned: 0 in 0.521s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:43 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] e49bac44-c124-47bb-b839-5895be946aa9 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 05:57:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:43 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 Sep 04 05:57:43 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:45 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7" returned: 0 in 2.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_81umn9b3devstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 05:57:45 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Converted 112.00 MB image at 48.39 MB/s Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:45 devstack sudo[92058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 1G Sep 04 05:57:45 devstack sudo[92058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:45 devstack sudo[92058]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 1G" returned: 0 in 0.402s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Downloaded image e49bac44-c124-47bb-b839-5895be946aa9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}])) to volume ea51c95c-0e3e-4344-bc22-7537248497f7 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Temporary image e49bac44-c124-47bb-b839-5895be946aa9 for user 764ca0d7d3b14691965c7c4c57854944 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Marking volume ea51c95c-0e3e-4344-bc22-7537248497f7 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Copying metadata from image e49bac44-c124-47bb-b839-5895be946aa9 to ea51c95c-0e3e-4344-bc22-7537248497f7. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Creating volume glance metadata for volume ea51c95c-0e3e-4344-bc22-7537248497f7 backed by image e49bac44-c124-47bb-b839-5895be946aa9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a769e55-3a54-4ce0-833e-84fad910cbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea51c95c-0e3e-4344-bc22-7537248497f7', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622b62e0-ca36-4b77-82a4-f91ec1af8251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:57:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Volume volume-ea51c95c-0e3e-4344-bc22-7537248497f7 (ea51c95c-0e3e-4344-bc22-7537248497f7): created successfully Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622b62e0-ca36-4b77-82a4-f91ec1af8251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:57:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Flow 'volume_create_manager' (ae5b8a7f-04ba-4313-bfd1-76795e45e3e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:57:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-db3d41af-e27c-42d1-864b-3aac3f6af316 tempest-ServerActionsTestOtherA-696632990 None] Created volume successfully. Sep 04 05:57:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Acquiring lock "cinder-77c99980-017b-4088-827b-0b96d4ac3011-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:57:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Lock "cinder-77c99980-017b-4088-827b-0b96d4ac3011-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:57:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Acquiring lock "cinder-quobyte-77c99980-017b-4088-827b-0b96d4ac3011" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:57:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Lock "cinder-quobyte-77c99980-017b-4088-827b-0b96d4ac3011" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:57:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ff9c0c-e446-4013-b9d1-57843519d5ac]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:57:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-77c99980-017b-4088-827b-0b96d4ac3011 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:46 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-77c99980-017b-4088-827b-0b96d4ac3011 Sep 04 05:57:46 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:46 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-77c99980-017b-4088-827b-0b96d4ac3011" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-77c99980-017b-4088-827b-0b96d4ac3011 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:46 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-77c99980-017b-4088-827b-0b96d4ac3011 Sep 04 05:57:46 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:47 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-77c99980-017b-4088-827b-0b96d4ac3011" returned: 0 in 0.274s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Lock "cinder-quobyte-77c99980-017b-4088-827b-0b96d4ac3011" released by "delete_volume" :: held 0.684s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:57:47 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Created reservations ['d1460e5d-e968-4c58-bc47-6082d0608a34', '358598e4-23b1-4745-a07f-855b8beba07a', '78637ed2-c930-4997-a137-f2d0822fa335', 'daf10a7b-60ce-45ae-9676-678be253bc23'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:57:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:57:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:57:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:57:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:57:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:57:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:57:47 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:57:47 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:57:47 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Sep 04 05:57:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.289s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:57:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:57:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Deleted volume successfully. Sep 04 05:57:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dc6f7d37-13f7-4c31-954b-1642f37c102d tempest-TaggedAttachmentsTest-256430779 None] Lock "cinder-77c99980-017b-4088-827b-0b96d4ac3011-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:57:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-a562cc24-b97f-4a18-ae17-d878bf2990c0 req-60397423-c51f-4c88-944c-5dc1402f8352 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:57:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-a562cc24-b97f-4a18-ae17-d878bf2990c0 req-60397423-c51f-4c88-944c-5dc1402f8352 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:57:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-a562cc24-b97f-4a18-ae17-d878bf2990c0 req-60397423-c51f-4c88-944c-5dc1402f8352 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:57:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-a562cc24-b97f-4a18-ae17-d878bf2990c0 req-60397423-c51f-4c88-944c-5dc1402f8352 tempest-ServerActionsTestOtherA-696632990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-ea51c95c-0e3e-4344-bc22-7537248497f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df99eb93-89ae-4a38-8aaf-e68d2438cdeb', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 05:57:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-a562cc24-b97f-4a18-ae17-d878bf2990c0 req-60397423-c51f-4c88-944c-5dc1402f8352 tempest-ServerActionsTestOtherA-696632990 None] attachment_update completed successfully. Sep 04 05:58:00 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=21,cinder:UPDATE=16,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:58:00 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=39,cinder:UPDATE=16,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:58:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Acquiring lock "cinder-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:58:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Lock "cinder-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:58:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Acquiring lock "cinder-quobyte-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:58:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Lock "cinder-quobyte-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:58:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d2d4a3-b5d5-4c36-9c1f-4a5aada5c85c]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:58:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:01 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f Sep 04 05:58:01 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:01 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f" returned: 0 in 0.685s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:01 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f Sep 04 05:58:01 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:02 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f" returned: 0 in 0.416s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Lock "cinder-quobyte-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f" released by "delete_volume" :: held 1.174s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:58:02 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Created reservations ['bff78bae-c9b8-4e28-ac84-f03081a88492', 'f20317f7-19b9-4d50-89e1-199536f1433e', 'd2f5f41b-69dc-40a9-b4d9-696036e67901', 'f66135b8-b85e-440f-a53f-603cf89cd3a1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:58:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:58:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:58:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:02 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:58:02 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:03 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.592s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:03 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:58:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Deleted volume successfully. Sep 04 05:58:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0d432f2e-484a-48db-a01d-e1dcc203be57 tempest-AttachVolumeShelveTestJSON-1114145371 None] Lock "cinder-bcbc11b6-5fe8-42c9-9f6c-3805e68d3d8f-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:58:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:58:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Flow 'volume_create_manager' (b7927165-0b27-4838-851d-cc23e4ba68da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:58:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdb5b12-26d9-41ec-bea5-7bf1239bdf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdb5b12-26d9-41ec-bea5-7bf1239bdf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-242082640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc14e61-9b39-48b1-84a1-ff894b369e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f626d503b234c218bce56dc6e9f4c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:04Z,use_quota=True,user_id='c230a92d3bc44b94b65497f3de6a7bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d234d25c-ce79-4b92-986a-77eeca844e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d234d25c-ce79-4b92-986a-77eeca844e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a067a84-11ca-4d80-a047-e3674a6dc25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a067a84-11ca-4d80-a047-e3674a6dc25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc14e61-9b39-48b1-84a1-ff894b369e1e', 'volume_name': 'volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9ecb46-653f-4c48-8221-7d6ce437c35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9ecb46-653f-4c48-8221-7d6ce437c35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08d36ab-d706-4b10-9865-5d91b6cda938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Volume 1bc14e61-9b39-48b1-84a1-ff894b369e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e', 'volume_size': 1} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-242082640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc14e61-9b39-48b1-84a1-ff894b369e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f626d503b234c218bce56dc6e9f4c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:04Z,use_quota=True,user_id='c230a92d3bc44b94b65497f3de6a7bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Creating volume 1bc14e61-9b39-48b1-84a1-ff894b369e1e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:58:04 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:58:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:04 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e 1073741824 Sep 04 05:58:04 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:05 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e 1073741824" returned: 0 in 0.857s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:05 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e Sep 04 05:58:05 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:05 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e" returned: 0 in 0.462s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:58:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08d36ab-d706-4b10-9865-5d91b6cda938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da04d6a-b772-4214-8ced-2b0fa86a90c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Volume volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e (1bc14e61-9b39-48b1-84a1-ff894b369e1e): created successfully Sep 04 05:58:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da04d6a-b772-4214-8ced-2b0fa86a90c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Flow 'volume_create_manager' (b7927165-0b27-4838-851d-cc23e4ba68da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:58:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1f08b93d-623a-4692-a1de-d3bf4ad51d1a tempest-AttachVolumeTestJSON-1586140776 None] Created volume successfully. Sep 04 05:58:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-8cdf5e2c-f2f7-46a1-8f4e-e188a042d484 req-f7b203af-d3c4-4b7e-b66d-f22515a82186 tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-8cdf5e2c-f2f7-46a1-8f4e-e188a042d484 req-f7b203af-d3c4-4b7e-b66d-f22515a82186 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-8cdf5e2c-f2f7-46a1-8f4e-e188a042d484 req-f7b203af-d3c4-4b7e-b66d-f22515a82186 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-8cdf5e2c-f2f7-46a1-8f4e-e188a042d484 req-f7b203af-d3c4-4b7e-b66d-f22515a82186 tempest-AttachVolumeTestJSON-1586140776 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'daba6255-1f2a-4ec8-8184-6fe6e065c971', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 05:58:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-8cdf5e2c-f2f7-46a1-8f4e-e188a042d484 req-f7b203af-d3c4-4b7e-b66d-f22515a82186 tempest-AttachVolumeTestJSON-1586140776 None] attachment_update completed successfully. Sep 04 05:58:17 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=12,cinder:SELECT=10,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:58:17 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=13 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:58:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4b5a2a66-a4d5-4947-9e35-79b01e6b8abc tempest-GroupSnapshotsTest-755642967 None] Group tempest-GroupSnapshotsTest-Group-375790184: creating Sep 04 05:58:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4b5a2a66-a4d5-4947-9e35-79b01e6b8abc tempest-GroupSnapshotsTest-755642967 None] Group tempest-GroupSnapshotsTest-Group-375790184: created successfully Sep 04 05:58:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4b5a2a66-a4d5-4947-9e35-79b01e6b8abc tempest-GroupSnapshotsTest-755642967 None] Create group completed successfully. Sep 04 05:58:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-0d5fcdd4-1cae-4e3c-8090-0895722a746f req-4faa2ef1-24b0-4982-a135-ff6fecc6fd90 tempest-ServerActionsTestOtherA-696632990 None] Terminate volume connection completed successfully. Sep 04 05:58:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-0d5fcdd4-1cae-4e3c-8090-0895722a746f req-4faa2ef1-24b0-4982-a135-ff6fecc6fd90 tempest-ServerActionsTestOtherA-696632990 None] Deleting attachment df99eb93-89ae-4a38-8aaf-e68d2438cdeb. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Flow 'volume_create_manager' (a231b38a-716d-4eef-9485-9ce679546542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbe8aa7-396c-4031-b9c8-6439ef75df09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbe8aa7-396c-4031-b9c8-6439ef75df09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1491351568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4664013-436c-4293-8135-66a0d68cac7a,host='devstack@QuobyteHD#QuobyteHD',id=0ed9764b-ae3f-4bda-8241-498586698fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd61e8aaf344a13839a5b3488641fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:21Z,use_quota=True,user_id='e28e4242a8fa42f3b027d7ae1630ac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a1dddc-5cad-4cb4-b56d-afaf51d533f6),volume_type_id=c1a1dddc-5cad-4cb4-b56d-afaf51d533f6)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4f6a1a-9036-4f96-b3b8-0bef4a329ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4f6a1a-9036-4f96-b3b8-0bef4a329ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfef272-30f0-4b10-991e-0bd7c34d89b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfef272-30f0-4b10-991e-0bd7c34d89b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed9764b-ae3f-4bda-8241-498586698fc0', 'volume_name': 'volume-0ed9764b-ae3f-4bda-8241-498586698fc0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab391ae3-022d-4807-a0ee-c06d13f66794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab391ae3-022d-4807-a0ee-c06d13f66794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec56b10-71ff-4045-9d37-5349300bebe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Volume 0ed9764b-ae3f-4bda-8241-498586698fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed9764b-ae3f-4bda-8241-498586698fc0', 'volume_size': 1} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e4664013-436c-4293-8135-66a0d68cac7a,created_at=2026-09-04T03:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1491351568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4664013-436c-4293-8135-66a0d68cac7a,host='devstack@QuobyteHD#QuobyteHD',id=0ed9764b-ae3f-4bda-8241-498586698fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd61e8aaf344a13839a5b3488641fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:21Z,use_quota=True,user_id='e28e4242a8fa42f3b027d7ae1630ac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a1dddc-5cad-4cb4-b56d-afaf51d533f6),volume_type_id=c1a1dddc-5cad-4cb4-b56d-afaf51d533f6)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Creating volume 0ed9764b-ae3f-4bda-8241-498586698fc0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:58:21 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:58:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:21 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 1073741824 Sep 04 05:58:21 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:22 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 1073741824" returned: 0 in 0.618s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:22 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 Sep 04 05:58:22 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:22 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0" returned: 0 in 0.492s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:58:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec56b10-71ff-4045-9d37-5349300bebe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed9764b-ae3f-4bda-8241-498586698fc0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c237b629-1bf4-4a46-b24b-522cbe805a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Volume volume-0ed9764b-ae3f-4bda-8241-498586698fc0 (0ed9764b-ae3f-4bda-8241-498586698fc0): created successfully Sep 04 05:58:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c237b629-1bf4-4a46-b24b-522cbe805a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Flow 'volume_create_manager' (a231b38a-716d-4eef-9485-9ce679546542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:58:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8943e554-325b-4312-bcbd-9a9c3a584d87 tempest-GroupSnapshotsTest-755642967 None] Created volume successfully. Sep 04 05:58:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-0d5fcdd4-1cae-4e3c-8090-0895722a746f req-0a92d57f-22c0-4121-a3a5-dba52d312d66 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-0d5fcdd4-1cae-4e3c-8090-0895722a746f req-0a92d57f-22c0-4121-a3a5-dba52d312d66 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-0d5fcdd4-1cae-4e3c-8090-0895722a746f req-0a92d57f-22c0-4121-a3a5-dba52d312d66 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-0d5fcdd4-1cae-4e3c-8090-0895722a746f req-0a92d57f-22c0-4121-a3a5-dba52d312d66 tempest-ServerActionsTestOtherA-696632990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-ea51c95c-0e3e-4344-bc22-7537248497f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '599cfec6-4464-4aa2-9c2f-99e2f43d1464', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 05:58:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-0d5fcdd4-1cae-4e3c-8090-0895722a746f req-0a92d57f-22c0-4121-a3a5-dba52d312d66 tempest-ServerActionsTestOtherA-696632990 None] attachment_update completed successfully. Sep 04 05:58:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] GroupSnapshot f9abfd02-2535-4d80-8bd6-e50dced8e2c4: creating. Sep 04 05:58:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] Group snapshot f9abfd02-2535-4d80-8bd6-e50dced8e2c4: creating. {{(pid=87132) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 05:58:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] Creating offline snapshot e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a of volume 0ed9764b-ae3f-4bda-8241-498586698fc0 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 05:58:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ffdf2d-696e-4d21-99f8-2309eda4875b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:58:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:24 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 Sep 04 05:58:24 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0" returned: 0 in 0.641s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:25 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:25 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a 1G Sep 04 05:58:25 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:25 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:58:25 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:25 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.481s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 05:58:25 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a 1G" returned: 0 in 0.880s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ed9764b-ae3f-4bda-8241-498586698fc0 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:26 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ed9764b-ae3f-4bda-8241-498586698fc0 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a Sep 04 05:58:26 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:26 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ed9764b-ae3f-4bda-8241-498586698fc0 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a" returned: 0 in 0.541s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:26 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a is being set with open permissions: ugo+rw: NotImplementedError Sep 04 05:58:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:26 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a Sep 04 05:58:26 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:27 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a" returned: 0 in 0.620s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:27 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.info Sep 04 05:58:27 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:27 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.info" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:27 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 05:58:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:27 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.info Sep 04 05:58:27 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:27 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.info" returned: 0 in 0.294s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.574s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-07983812-325a-4eca-bf82-e828c80f56b9 tempest-GroupSnapshotsTest-755642967 None] group_snapshot f9abfd02-2535-4d80-8bd6-e50dced8e2c4: created successfully Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a-4da9d2da-78fa-4363-8efd-9fe723e015c1" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a-4da9d2da-78fa-4363-8efd-9fe723e015c1" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Creating volume 4da9d2da-78fa-4363-8efd-9fe723e015c1 from snapshot e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-4da9d2da-78fa-4363-8efd-9fe723e015c1" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-4da9d2da-78fa-4363-8efd-9fe723e015c1" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] snapshot: e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a, volume: 4da9d2da-78fa-4363-8efd-9fe723e015c1, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[39776820-2a4d-41ce-9e54-5fc23953b996]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:58:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:31 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a Sep 04 05:58:31 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:32 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a" returned: 0 in 1.070s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ed9764b-ae3f-4bda-8241-498586698fc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 05:58:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a0bef9-8301-4d35-a212-72cae4938b48]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:58:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:32 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 Sep 04 05:58:32 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:33 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0" returned: 0 in 0.966s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] will copy from snapshot at /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 05:58:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 05:58:33 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Path /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 05:58:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:33 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1 Sep 04 05:58:33 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=15,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:58:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=24,cinder:UPDATE=6 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:58:42 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1" returned: 0 in 9.793s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:42 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0, size 1024.00 MB, duration 9.80 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 05:58:42 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Converted 1024.00 MB image at 104.54 MB/s Sep 04 05:58:42 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 05:58:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:42 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1 Sep 04 05:58:42 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:43 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1" returned: 0 in 0.376s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-4da9d2da-78fa-4363-8efd-9fe723e015c1" released by "_copy_volume_from_snapshot" :: held 12.404s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:58:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a-4da9d2da-78fa-4363-8efd-9fe723e015c1" released by "_create_volume_from_snapshot" :: held 12.570s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:58:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.628s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f312d8b6-7d1c-4403-a471-7bb95da3d988 tempest-GroupSnapshotsTest-755642967 None] Create group from source-snapshot-f9abfd02-2535-4d80-8bd6-e50dced8e2c4 completed successfully. Sep 04 05:58:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-4da9d2da-78fa-4363-8efd-9fe723e015c1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:58:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-4da9d2da-78fa-4363-8efd-9fe723e015c1" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:58:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ba5c0a-a2de-442d-9eb7-88bd8a8f2006]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:58:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:45 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1 Sep 04 05:58:45 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:45 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1" returned: 0 in 0.644s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:45 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1 Sep 04 05:58:45 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:46 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4da9d2da-78fa-4363-8efd-9fe723e015c1" returned: 0 in 0.645s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-4da9d2da-78fa-4363-8efd-9fe723e015c1" released by "delete_volume" :: held 1.425s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:58:46 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Created reservations ['e14a8014-4c1b-4bb9-9690-7bfba4baac8f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:58:46 devstack cinder-volume[87132]: WARNING cinder.quota [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-281735667 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-281735667, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:58:46 devstack cinder-volume[87132]: WARNING cinder.quota [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-281735667 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-281735667, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:58:46 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Created reservations ['1fdd41d9-9fe0-4351-8110-ef5e65ae34d9', 'b39af04f-997f-4ce7-b41a-e62a3f585213', 'b86c20d4-0cc5-4ef3-b723-0d77c3c456ae', '805c4ec8-f14c-473f-9cb2-f9b75690db84'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:58:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:58:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:58:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:46 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:58:46 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:47 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.800s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:58:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-29e51f89-9732-46a0-8717-563b1188123b tempest-GroupSnapshotsTest-755642967 None] Delete group completed successfully. Sep 04 05:58:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] group_snapshot f9abfd02-2535-4d80-8bd6-e50dced8e2c4: deleting Sep 04 05:58:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] group_snapshot f9abfd02-2535-4d80-8bd6-e50dced8e2c4: deleting {{(pid=87132) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 05:58:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-0ed9764b-ae3f-4bda-8241-498586698fc0" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:58:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-0ed9764b-ae3f-4bda-8241-498586698fc0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:58:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:58:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:58:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Deleting offline snapshot e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a of volume 0ed9764b-ae3f-4bda-8241-498586698fc0 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 05:58:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] snapshot_file for this snap is: volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 05:58:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b27abb1-0fba-439a-9874-72b4e37cfc0d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:58:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:48 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a Sep 04 05:58:48 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:48 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a" returned: 0 in 0.642s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ed9764b-ae3f-4bda-8241-498586698fc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 05:58:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[469fab57-eb6b-4236-8a2c-6001e5e2a246]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:58:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:48 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 Sep 04 05:58:48 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:49 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0" returned: 0 in 0.805s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:49 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a Sep 04 05:58:49 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:49 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a" returned: 0 in 0.408s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:49 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a Sep 04 05:58:49 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:50 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0.e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a" returned: 0 in 0.525s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-e41ccf1f-a5fd-4b90-805d-4d14c6e15c6a" released by "_delete_snapshot" :: held 2.597s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:58:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-0ed9764b-ae3f-4bda-8241-498586698fc0" released by "delete_snapshot" :: held 2.643s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:58:50 devstack cinder-volume[87132]: WARNING cinder.quota [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-281735667 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-281735667, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:58:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] Created reservations ['30026f07-13c3-4991-8370-8552851f49b6', '01f2c295-3731-4a72-9d03-2332eee8ce4d', 'e142af1c-814c-4824-92e8-9f464f1ce830', '52d25706-1dea-475a-aa89-bccbe6b14554'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:58:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0f3e793b-e3c3-4dea-9313-e76f942a410f tempest-GroupSnapshotsTest-755642967 None] group_snapshot f9abfd02-2535-4d80-8bd6-e50dced8e2c4: deleted successfully Sep 04 05:58:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-0ed9764b-ae3f-4bda-8241-498586698fc0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:58:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-0ed9764b-ae3f-4bda-8241-498586698fc0" acquired by "delete_volume" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:58:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9399d845-6ed1-48e4-af9c-c5b30285ed25]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:58:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:52 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 Sep 04 05:58:52 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:52 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0" returned: 0 in 0.520s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:52 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0 Sep 04 05:58:52 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:52 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0ed9764b-ae3f-4bda-8241-498586698fc0" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-0ed9764b-ae3f-4bda-8241-498586698fc0" released by "delete_volume" :: held 0.947s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:58:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Created reservations ['b1063476-2b6f-4655-9ed1-06c294bc3da8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:58:52 devstack cinder-volume[87132]: WARNING cinder.db.api [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-281735667'] Sep 04 05:58:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Created reservations ['8e90a86d-5507-416c-b45b-f33ce1cadb1e', '714ef9f5-c8c4-480d-b880-9c4b817b5faf', '9d14fc2e-7dc1-4342-8fe8-cb4c7c774dfc', '79d812aa-3f7c-4fb9-bd80-85adb89c3d2e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:58:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:58:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:58:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:53 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:58:53 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:53 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.372s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:58:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1b3458d7-78ee-42ca-a575-657a8b521bf9 tempest-GroupSnapshotsTest-755642967 None] Delete group completed successfully. Sep 04 05:58:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d0cbc3d1-66a2-496a-bb9b-1abb9f1e4fa1 tempest-GroupSnapshotsTest-755642967 None] Group tempest-GroupSnapshotsTest-Group-1571885294: creating Sep 04 05:58:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d0cbc3d1-66a2-496a-bb9b-1abb9f1e4fa1 tempest-GroupSnapshotsTest-755642967 None] Group tempest-GroupSnapshotsTest-Group-1571885294: created successfully Sep 04 05:58:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d0cbc3d1-66a2-496a-bb9b-1abb9f1e4fa1 tempest-GroupSnapshotsTest-755642967 None] Create group completed successfully. Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Flow 'volume_create_manager' (67aaf5fe-3232-4c5c-8d36-27ce63b16099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c84cfb-7eec-47c1-90dd-d908b855eb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c84cfb-7eec-47c1-90dd-d908b855eb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1414016631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e229486-f144-4951-9290-996ee1c923fd,host='devstack@QuobyteHD#QuobyteHD',id=8580c64e-25ef-4ce8-a9a2-5d84e2812319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd61e8aaf344a13839a5b3488641fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:56Z,use_quota=True,user_id='e28e4242a8fa42f3b027d7ae1630ac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25df4abe-30f3-4349-9b06-4a6e776e2e14),volume_type_id=25df4abe-30f3-4349-9b06-4a6e776e2e14)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2cd2e0-172f-404e-876c-5ff45bca4834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2cd2e0-172f-404e-876c-5ff45bca4834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df15b8c1-44c7-45e8-b47d-d76ab4e88376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df15b8c1-44c7-45e8-b47d-d76ab4e88376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8580c64e-25ef-4ce8-a9a2-5d84e2812319', 'volume_name': 'volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6686eb4c-a59d-4ee0-98b9-24229f3fc901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6686eb4c-a59d-4ee0-98b9-24229f3fc901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63cecfe-c4fd-4532-a071-4000e57a285e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Volume 8580c64e-25ef-4ce8-a9a2-5d84e2812319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319', 'volume_size': 1} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e229486-f144-4951-9290-996ee1c923fd,created_at=2026-09-04T03:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1414016631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e229486-f144-4951-9290-996ee1c923fd,host='devstack@QuobyteHD#QuobyteHD',id=8580c64e-25ef-4ce8-a9a2-5d84e2812319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd61e8aaf344a13839a5b3488641fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:56Z,use_quota=True,user_id='e28e4242a8fa42f3b027d7ae1630ac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25df4abe-30f3-4349-9b06-4a6e776e2e14),volume_type_id=25df4abe-30f3-4349-9b06-4a6e776e2e14)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Creating volume 8580c64e-25ef-4ce8-a9a2-5d84e2812319 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:58:56 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:58:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:56 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 1073741824 Sep 04 05:58:56 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:57 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 1073741824" returned: 0 in 0.723s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:57 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 Sep 04 05:58:57 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:57 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319" returned: 0 in 0.326s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:58:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63cecfe-c4fd-4532-a071-4000e57a285e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f485a058-f9c8-4e30-aac8-13e6f3931c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Volume volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 (8580c64e-25ef-4ce8-a9a2-5d84e2812319): created successfully Sep 04 05:58:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f485a058-f9c8-4e30-aac8-13e6f3931c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Flow 'volume_create_manager' (67aaf5fe-3232-4c5c-8d36-27ce63b16099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:58:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-42d7f204-8ea1-4499-961c-6c32c66c139f tempest-GroupSnapshotsTest-755642967 None] Created volume successfully. Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Flow 'volume_create_manager' (e1c0172f-519a-45f9-a960-eefafcd32e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9962f3-2fab-4272-8986-e5e5eb54e7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9962f3-2fab-4272-8986-e5e5eb54e7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-684039176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4bd8a6-b45e-4ba1-8f3a-17de757b386f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c34dde1f98046b0a80519cab3f584c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:58Z,use_quota=True,user_id='2a848ac4ae8244c6b88062989cbf6a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b611c0-0b15-46d0-a376-c195eeda22e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b611c0-0b15-46d0-a376-c195eeda22e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba4e5e6-e608-4127-af6d-b4a0b0105599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba4e5e6-e608-4127-af6d-b4a0b0105599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe4bd8a6-b45e-4ba1-8f3a-17de757b386f', 'volume_name': 'volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61dc236d-629c-41da-be92-05e9800594e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61dc236d-629c-41da-be92-05e9800594e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba887dc3-491a-4bf9-bba3-1e73ec52c67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Volume fe4bd8a6-b45e-4ba1-8f3a-17de757b386f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f', 'volume_size': 1} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-684039176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4bd8a6-b45e-4ba1-8f3a-17de757b386f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c34dde1f98046b0a80519cab3f584c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:58Z,use_quota=True,user_id='2a848ac4ae8244c6b88062989cbf6a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Creating volume fe4bd8a6-b45e-4ba1-8f3a-17de757b386f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:58:58 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:58:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:58 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f 1073741824 Sep 04 05:58:58 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:59 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f 1073741824" returned: 0 in 0.756s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:58:59 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f Sep 04 05:58:59 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:58:59 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Sep 04 05:58:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:58:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:58:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:58:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba887dc3-491a-4bf9-bba3-1e73ec52c67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca67263-98ab-47e3-8b30-26ff6ad1f18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:58:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Volume volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f (fe4bd8a6-b45e-4ba1-8f3a-17de757b386f): created successfully Sep 04 05:58:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca67263-98ab-47e3-8b30-26ff6ad1f18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:58:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Flow 'volume_create_manager' (e1c0172f-519a-45f9-a960-eefafcd32e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:58:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-634c5f49-940b-4dd5-89a9-36fb0b5df2ef tempest-ServersNegativeTestJSON-128993768 None] Created volume successfully. Sep 04 05:58:59 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Flow 'volume_create_manager' (6a6a43ed-d3d3-4d1c-8ef7-80ea638f11e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e265c5-8f25-4459-ba57-24908a3b4cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e265c5-8f25-4459-ba57-24908a3b4cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-740413251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e229486-f144-4951-9290-996ee1c923fd,host='devstack@QuobyteHD#QuobyteHD',id=d08dc9e1-36a1-46f9-ab9d-412936e0b440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd61e8aaf344a13839a5b3488641fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:00Z,use_quota=True,user_id='e28e4242a8fa42f3b027d7ae1630ac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25df4abe-30f3-4349-9b06-4a6e776e2e14),volume_type_id=25df4abe-30f3-4349-9b06-4a6e776e2e14)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651e0cc0-547f-4f14-8c38-6ad1dd224e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651e0cc0-547f-4f14-8c38-6ad1dd224e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcde871-6028-48f0-8310-1164460a6443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcde871-6028-48f0-8310-1164460a6443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08dc9e1-36a1-46f9-ab9d-412936e0b440', 'volume_name': 'volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91497a47-6a68-4f6c-a2fc-f822bdbcb6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91497a47-6a68-4f6c-a2fc-f822bdbcb6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f71ef8-8af3-41c5-bf7a-c2805e85a4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Volume d08dc9e1-36a1-46f9-ab9d-412936e0b440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440', 'volume_size': 1} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e229486-f144-4951-9290-996ee1c923fd,created_at=2026-09-04T03:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-740413251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e229486-f144-4951-9290-996ee1c923fd,host='devstack@QuobyteHD#QuobyteHD',id=d08dc9e1-36a1-46f9-ab9d-412936e0b440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd61e8aaf344a13839a5b3488641fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:00Z,use_quota=True,user_id='e28e4242a8fa42f3b027d7ae1630ac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25df4abe-30f3-4349-9b06-4a6e776e2e14),volume_type_id=25df4abe-30f3-4349-9b06-4a6e776e2e14)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Creating volume d08dc9e1-36a1-46f9-ab9d-412936e0b440 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:59:00 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:00 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 1073741824 Sep 04 05:59:00 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:00 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 1073741824" returned: 0 in 0.785s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:01 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 Sep 04 05:59:01 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-f947d0ea-17ae-48fd-96e1-c28a73234a33 tempest-ServerActionsTestOtherA-696632990 None] Terminate volume connection completed successfully. Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-f947d0ea-17ae-48fd-96e1-c28a73234a33 tempest-ServerActionsTestOtherA-696632990 None] Deleting attachment 599cfec6-4464-4aa2-9c2f-99e2f43d1464. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 05:59:01 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440" returned: 0 in 0.414s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f71ef8-8af3-41c5-bf7a-c2805e85a4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8874f5-b0d6-4382-aeec-b6205879171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Volume volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 (d08dc9e1-36a1-46f9-ab9d-412936e0b440): created successfully Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8874f5-b0d6-4382-aeec-b6205879171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Flow 'volume_create_manager' (6a6a43ed-d3d3-4d1c-8ef7-80ea638f11e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3dc919c8-a3fd-4917-ae25-de6f26a85794 tempest-GroupSnapshotsTest-755642967 None] Created volume successfully. Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "cinder-ea51c95c-0e3e-4344-bc22-7537248497f7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Lock "cinder-ea51c95c-0e3e-4344-bc22-7537248497f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "cinder-quobyte-ea51c95c-0e3e-4344-bc22-7537248497f7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Lock "cinder-quobyte-ea51c95c-0e3e-4344-bc22-7537248497f7" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae03371-2b89-481e-9a48-946bd6990b35]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:01 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 Sep 04 05:59:01 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:02 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7" returned: 0 in 0.452s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:02 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7 Sep 04 05:59:02 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Flow 'volume_create_manager' (d3ffaf33-9712-4836-b1ce-f3e82d7aa541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23a2565-e4a5-44d2-a562-88937886a12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23a2565-e4a5-44d2-a562-88937886a12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-19708185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f33c10-708c-4c5d-bf63-8c3f65cbabd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c34dde1f98046b0a80519cab3f584c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:02Z,use_quota=True,user_id='2a848ac4ae8244c6b88062989cbf6a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818f909d-fa8c-4f1a-ba34-8707f7425673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818f909d-fa8c-4f1a-ba34-8707f7425673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a861ab8-7691-447e-a4c0-262b8ca52e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a861ab8-7691-447e-a4c0-262b8ca52e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f33c10-708c-4c5d-bf63-8c3f65cbabd6', 'volume_name': 'volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b57a85c-0711-46f6-b9de-a4940ec2811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b57a85c-0711-46f6-b9de-a4940ec2811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc577ce-0117-4f39-9b06-386524a136d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Volume c7f33c10-708c-4c5d-bf63-8c3f65cbabd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6', 'volume_size': 1} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-19708185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f33c10-708c-4c5d-bf63-8c3f65cbabd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c34dde1f98046b0a80519cab3f584c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:02Z,use_quota=True,user_id='2a848ac4ae8244c6b88062989cbf6a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Creating volume c7f33c10-708c-4c5d-bf63-8c3f65cbabd6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:59:02 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:02 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ea51c95c-0e3e-4344-bc22-7537248497f7" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:02 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6 1073741824 Sep 04 05:59:02 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Lock "cinder-quobyte-ea51c95c-0e3e-4344-bc22-7537248497f7" released by "delete_volume" :: held 0.892s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.quota [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Created reservations ['e5e034a1-100f-425f-a8ae-f5b457e1186b', '6709901e-45f1-4c49-8a53-a8f4d4a1d8fa', '9f4e60d9-e5f4-4d1e-9766-6b9a9fe5cfd6', '7771c589-01e2-485a-90a3-57d436e8e6d2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "cinder-df3f279c-b9a3-4df5-ab17-b48dfa895f24-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:02 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:59:02 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Lock "cinder-df3f279c-b9a3-4df5-ab17-b48dfa895f24-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "cinder-quobyte-df3f279c-b9a3-4df5-ab17-b48dfa895f24" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Lock "cinder-quobyte-df3f279c-b9a3-4df5-ab17-b48dfa895f24" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc57ad71-432d-4dab-a149-5bb80600a129]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b2578b4f-d181-449d-9825-88190e521239 tempest-GroupSnapshotsTest-755642967 None] Update group completed successfully. Sep 04 05:59:02 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.manager [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:59:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Deleted volume successfully. Sep 04 05:59:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-4a419678-d8ee-4eec-ba9b-0b122208be3f req-47277f38-223a-4acb-9198-ee61fe6e5264 tempest-ServerActionsTestOtherA-696632990 None] Lock "cinder-ea51c95c-0e3e-4344-bc22-7537248497f7-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:02 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24 Sep 04 05:59:02 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:02 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6 1073741824" returned: 0 in 0.617s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:03 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6 Sep 04 05:59:03 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:03 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:03 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24 Sep 04 05:59:03 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:03 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6" returned: 0 in 0.302s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc577ce-0117-4f39-9b06-386524a136d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad199c4e-11fb-4ffc-b393-96d8229854d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Volume volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6 (c7f33c10-708c-4c5d-bf63-8c3f65cbabd6): created successfully Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad199c4e-11fb-4ffc-b393-96d8229854d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Flow 'volume_create_manager' (d3ffaf33-9712-4836-b1ce-f3e82d7aa541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a658ce6d-2da0-40af-bcc0-416a52a7c520 tempest-ServersNegativeTestJSON-128993768 None] Created volume successfully. Sep 04 05:59:03 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df3f279c-b9a3-4df5-ab17-b48dfa895f24" returned: 0 in 0.297s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Lock "cinder-quobyte-df3f279c-b9a3-4df5-ab17-b48dfa895f24" released by "delete_volume" :: held 0.773s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Created reservations ['abf3623a-453e-4326-8f9a-b751490fc692', '5177c465-306c-4236-9cee-ba76c1742256', '97d75401-eff8-444b-8906-5e149393be71', '0a5c9a74-4bbf-4b95-a997-002ee036daf6'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:03 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:59:03 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-51707fd5-883a-4d92-9651-3f5c207957cf tempest-GroupSnapshotsTest-755642967 None] Update group completed successfully. Sep 04 05:59:04 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:04 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:59:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Deleted volume successfully. Sep 04 05:59:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7fcd776b-3b5a-4bb9-862a-1379e4215ae0 tempest-ServerActionsTestOtherA-696632990 None] Lock "cinder-df3f279c-b9a3-4df5-ab17-b48dfa895f24-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Acquiring lock "cinder-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Lock "cinder-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Acquiring lock "cinder-quobyte-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Lock "cinder-quobyte-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18baeec-b43b-4cba-872b-1a6941e46407]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:05 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6 Sep 04 05:59:05 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-07c8cbd2-e1a3-4eaf-8948-7eac9472abf5 tempest-GroupSnapshotsTest-755642967 None] Update group completed successfully. Sep 04 05:59:05 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6" returned: 0 in 0.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:05 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6 Sep 04 05:59:05 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:05 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6" returned: 0 in 0.344s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Lock "cinder-quobyte-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6" released by "delete_volume" :: held 0.935s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:05 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Created reservations ['3e8b2a8f-31e6-495a-b4bd-b4b46befa219', 'd113568c-a1a1-4dd2-8730-4b14478b5b26', '5c20c084-cb3f-403b-a0e4-f184650c4cc2', '1e0c4b38-aa14-4b96-aebc-c675b09d5c13'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:06 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:59:06 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:06 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:06 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:59:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Deleted volume successfully. Sep 04 05:59:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e90dd6fe-7212-4d24-92f4-c8802487baf7 tempest-ServersNegativeTestJSON-128993768 None] Lock "cinder-c7f33c10-708c-4c5d-bf63-8c3f65cbabd6-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cb067420-ed4e-4a73-a390-f04d2e10aa21 tempest-GroupSnapshotsTest-755642967 None] Update group completed successfully. Sep 04 05:59:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Acquiring lock "cinder-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Lock "cinder-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Acquiring lock "cinder-quobyte-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Lock "cinder-quobyte-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5a3d05-acf8-4988-acfd-14b642dfef03]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:07 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f Sep 04 05:59:07 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:07 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f" returned: 0 in 0.424s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:07 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f Sep 04 05:59:07 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:08 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Lock "cinder-quobyte-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f" released by "delete_volume" :: held 0.816s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Created reservations ['f0f6b707-9c97-471f-bfb5-94eba22792bf', '6855babf-ae6a-49c7-96b0-7387a83cfc18', '45a3c593-075b-4366-8e4b-8223027dbe49', 'dc43cc72-7bb3-4e0f-8ab3-98cb7a3f6314'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] GroupSnapshot 8e49e13e-8524-4a2a-b10d-baa265a1644a: creating. Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Group snapshot 8e49e13e-8524-4a2a-b10d-baa265a1644a: creating. {{(pid=87132) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Creating offline snapshot 21f841a8-7c42-4849-b56f-ad0d725c24bd of volume d08dc9e1-36a1-46f9-ab9d-412936e0b440 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 05:59:08 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:59:08 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ee513d-e4e2-45ab-bf4d-1f7f50693ea6]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:08 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 Sep 04 05:59:08 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:08 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:59:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Deleted volume successfully. Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f53b0701-d698-4b0d-989c-75857b98335e tempest-ServersNegativeTestJSON-128993768 None] Lock "cinder-fe4bd8a6-b45e-4ba1-8f3a-17de757b386f-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:08 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440" returned: 0 in 0.538s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:08 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd 1G Sep 04 05:59:08 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:09 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd 1G" returned: 0 in 0.719s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:09 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd Sep 04 05:59:09 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:09 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd" returned: 0 in 0.372s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:09 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd is being set with open permissions: ugo+rw: NotImplementedError Sep 04 05:59:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:09 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd Sep 04 05:59:09 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:10 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:10 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.info Sep 04 05:59:10 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:10 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.info" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:10 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 05:59:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:10 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.info Sep 04 05:59:10 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:11 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.info" returned: 0 in 0.358s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.843s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Creating offline snapshot 94fc6fbe-4bd5-440c-a8da-f7a8782abb41 of volume 8580c64e-25ef-4ce8-a9a2-5d84e2812319 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 05:59:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80c3407-8442-443d-a75f-9a3414ad8941]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:11 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 Sep 04 05:59:11 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:11 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:11 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 1G Sep 04 05:59:11 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:11 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 1G" returned: 0 in 0.459s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:12 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 Sep 04 05:59:12 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:12 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:12 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 05:59:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:12 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 Sep 04 05:59:12 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:12 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:12 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.info Sep 04 05:59:12 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:13 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.info" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:13 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 05:59:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:13 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.info Sep 04 05:59:13 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:13 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.info" returned: 0 in 0.289s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e48dbd90-6a44-4497-902e-256b67fd7a5b tempest-GroupSnapshotsTest-755642967 None] group_snapshot 8e49e13e-8524-4a2a-b10d-baa265a1644a: created successfully Sep 04 05:59:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] group_snapshot 8e49e13e-8524-4a2a-b10d-baa265a1644a: deleting Sep 04 05:59:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] group_snapshot 8e49e13e-8524-4a2a-b10d-baa265a1644a: deleting {{(pid=87132) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 05:59:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-d08dc9e1-36a1-46f9-ab9d-412936e0b440" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-d08dc9e1-36a1-46f9-ab9d-412936e0b440" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-21f841a8-7c42-4849-b56f-ad0d725c24bd" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-21f841a8-7c42-4849-b56f-ad0d725c24bd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Deleting offline snapshot 21f841a8-7c42-4849-b56f-ad0d725c24bd of volume d08dc9e1-36a1-46f9-ab9d-412936e0b440 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 05:59:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] snapshot_file for this snap is: volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 05:59:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9376e606-3070-4b9b-b175-f91f9f2efb95]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:14 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd Sep 04 05:59:14 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:15 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd" returned: 0 in 0.463s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 05:59:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7538967-677c-4388-9a5e-7d1edbba8348]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:15 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 Sep 04 05:59:15 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:15 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440" returned: 0 in 0.444s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:15 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd Sep 04 05:59:15 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:16 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd" returned: 0 in 0.424s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:16 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd Sep 04 05:59:16 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:16 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440.21f841a8-7c42-4849-b56f-ad0d725c24bd" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-21f841a8-7c42-4849-b56f-ad0d725c24bd" released by "_delete_snapshot" :: held 1.773s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-d08dc9e1-36a1-46f9-ab9d-412936e0b440" released by "delete_snapshot" :: held 1.803s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-8580c64e-25ef-4ce8-a9a2-5d84e2812319" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-8580c64e-25ef-4ce8-a9a2-5d84e2812319" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-94fc6fbe-4bd5-440c-a8da-f7a8782abb41" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-94fc6fbe-4bd5-440c-a8da-f7a8782abb41" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Deleting offline snapshot 94fc6fbe-4bd5-440c-a8da-f7a8782abb41 of volume 8580c64e-25ef-4ce8-a9a2-5d84e2812319 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] snapshot_file for this snap is: volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c05a51-22e7-46a2-82d5-03b6ed932697]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:16 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 Sep 04 05:59:16 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:17 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41" returned: 0 in 0.545s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 05:59:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95b749f-8276-4e5e-86f5-35a35f88ea40]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:17 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 Sep 04 05:59:17 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:17 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319" returned: 0 in 0.429s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:17 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 Sep 04 05:59:17 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:18 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41" returned: 0 in 0.463s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:18 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41 Sep 04 05:59:18 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:18 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319.94fc6fbe-4bd5-440c-a8da-f7a8782abb41" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-94fc6fbe-4bd5-440c-a8da-f7a8782abb41" released by "_delete_snapshot" :: held 1.946s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-8580c64e-25ef-4ce8-a9a2-5d84e2812319" released by "delete_snapshot" :: held 1.976s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:18 devstack cinder-volume[87132]: WARNING cinder.quota [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1311561382 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1311561382, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:59:18 devstack cinder-volume[87132]: WARNING cinder.quota [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1311561382 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1311561382, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:59:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Created reservations ['0592ea0f-433a-4f92-8b2d-361e57e66fa3', '91678b6a-1e8e-49c2-b3a6-8c3a836bc22c', '1ff62149-8227-4b51-93b2-fd15385685c4', 'eebba186-0889-4372-9bfb-27260c391ed7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] Created reservations ['2427e90d-5652-4b49-8821-020f54e6a734', 'b9038e6a-0cd1-438f-aea3-5e60018f47b4', '59563134-ee83-4872-9320-c4d24a4e6db8', 'ee97b15f-74db-4543-bd92-bae8cf06fd62'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e716f0ab-4e79-4793-8bcf-06f1e14b8654 tempest-GroupSnapshotsTest-755642967 None] group_snapshot 8e49e13e-8524-4a2a-b10d-baa265a1644a: deleted successfully Sep 04 05:59:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-8580c64e-25ef-4ce8-a9a2-5d84e2812319" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-8580c64e-25ef-4ce8-a9a2-5d84e2812319" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe741dc-4f36-45d1-8138-b5ae0d0b0000]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:20 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 Sep 04 05:59:20 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:20 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319" returned: 0 in 0.473s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:20 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319 Sep 04 05:59:20 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:20 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8580c64e-25ef-4ce8-a9a2-5d84e2812319" returned: 0 in 0.365s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-8580c64e-25ef-4ce8-a9a2-5d84e2812319" released by "delete_volume" :: held 0.938s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-d08dc9e1-36a1-46f9-ab9d-412936e0b440" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-d08dc9e1-36a1-46f9-ab9d-412936e0b440" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e37af6-4b56-4d89-8be7-413bd897fc9b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:21 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 Sep 04 05:59:21 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:21 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440" returned: 0 in 0.576s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:21 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440 Sep 04 05:59:21 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:21 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d08dc9e1-36a1-46f9-ab9d-412936e0b440" returned: 0 in 0.279s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-d08dc9e1-36a1-46f9-ab9d-412936e0b440" released by "delete_volume" :: held 0.957s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Created reservations ['4684864b-ae0d-4696-8d7a-3ec9155c8665'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:22 devstack cinder-volume[87132]: WARNING cinder.quota [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1311561382 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1311561382, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Created reservations ['afcebd4d-5915-4a9e-b1af-a41177ee0302', 'a5fc40e1-9ac2-4a20-814b-db6fcefdf39b', 'bcafa1e5-7201-4036-97b8-603b3dc80544', '9b633db3-9f18-4fca-ac23-85920101dbba'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Created reservations ['773c4775-c142-4ca0-b68a-aa56523fb1f0', '95d4ba5d-7400-427a-a1a6-c61dd2cf3de7', '5a006ffc-99e7-496f-b571-abce1bcd0328', 'd81eaafb-5ed7-4f67-b3e7-85e7856bd01b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:22 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:59:22 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Flow 'volume_create_manager' (4f39161f-0797-43be-93e2-3c39c4aad7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfd7594-c48e-4b6e-bc30-ffe7aa41f1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfd7594-c48e-4b6e-bc30-ffe7aa41f1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1899653600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56169952-d93e-4c52-9481-ac9c339cc57f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d18d21db0ca748048a15cafa24302308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:22Z,use_quota=True,user_id='315802233b3a42f48143aea8677f29a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c33c1f0-0fd7-4d69-9b90-05184c7a8ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c33c1f0-0fd7-4d69-9b90-05184c7a8ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ef8bda-2526-4914-a471-83109c25a83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ef8bda-2526-4914-a471-83109c25a83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56169952-d93e-4c52-9481-ac9c339cc57f', 'volume_name': 'volume-56169952-d93e-4c52-9481-ac9c339cc57f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5053e803-00c1-4721-8f21-aabfe486a0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5053e803-00c1-4721-8f21-aabfe486a0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd587e6-47b1-4267-a874-218cc5ddde67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Volume 56169952-d93e-4c52-9481-ac9c339cc57f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56169952-d93e-4c52-9481-ac9c339cc57f', 'volume_size': 1} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1899653600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56169952-d93e-4c52-9481-ac9c339cc57f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d18d21db0ca748048a15cafa24302308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:22Z,use_quota=True,user_id='315802233b3a42f48143aea8677f29a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Creating volume 56169952-d93e-4c52-9481-ac9c339cc57f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:59:22 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-56169952-d93e-4c52-9481-ac9c339cc57f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:22 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-56169952-d93e-4c52-9481-ac9c339cc57f 1073741824 Sep 04 05:59:22 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:22 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.569s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:22 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:59:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7881c6b5-13dd-4c53-a937-908064d4865d tempest-GroupSnapshotsTest-755642967 None] Delete group completed successfully. Sep 04 05:59:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1475ee49-e908-4ea7-8e96-57b60488c4d7 tempest-GroupSnapshotsTest-755642967 None] Group tempest-GroupSnapshotsTest-Group-52470120: creating Sep 04 05:59:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1475ee49-e908-4ea7-8e96-57b60488c4d7 tempest-GroupSnapshotsTest-755642967 None] Group tempest-GroupSnapshotsTest-Group-52470120: created successfully Sep 04 05:59:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1475ee49-e908-4ea7-8e96-57b60488c4d7 tempest-GroupSnapshotsTest-755642967 None] Create group completed successfully. Sep 04 05:59:23 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-56169952-d93e-4c52-9481-ac9c339cc57f 1073741824" returned: 0 in 0.703s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-56169952-d93e-4c52-9481-ac9c339cc57f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:23 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-56169952-d93e-4c52-9481-ac9c339cc57f Sep 04 05:59:23 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:23 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-56169952-d93e-4c52-9481-ac9c339cc57f" returned: 0 in 0.297s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:59:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd587e6-47b1-4267-a874-218cc5ddde67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56169952-d93e-4c52-9481-ac9c339cc57f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c43ae8-d254-4fcf-82ef-cb4de9f642b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Volume volume-56169952-d93e-4c52-9481-ac9c339cc57f (56169952-d93e-4c52-9481-ac9c339cc57f): created successfully Sep 04 05:59:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c43ae8-d254-4fcf-82ef-cb4de9f642b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Flow 'volume_create_manager' (4f39161f-0797-43be-93e2-3c39c4aad7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1580d77e-8bee-4580-8db2-8dbcccca22b2 tempest-VolumesTestJSON-1290984179 None] Created volume successfully. Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Flow 'volume_create_manager' (30e42465-d047-44c1-b23d-b814faa44ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d46e08-7478-43ad-ada9-7470f48038ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d46e08-7478-43ad-ada9-7470f48038ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886457969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f49ebc7a-1be3-471a-8116-623f70400764,host='devstack@QuobyteHD#QuobyteHD',id=4d9177db-64ea-4d0f-89d5-4a537c250d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd61e8aaf344a13839a5b3488641fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:25Z,use_quota=True,user_id='e28e4242a8fa42f3b027d7ae1630ac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe590452-d262-4f5f-b6cc-239532778300),volume_type_id=fe590452-d262-4f5f-b6cc-239532778300)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34411f33-3766-4a20-a9fd-4acf67d59565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34411f33-3766-4a20-a9fd-4acf67d59565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2d8a03-12e3-42aa-8a6b-776b35a7c652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:25 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:59:25 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2d8a03-12e3-42aa-8a6b-776b35a7c652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d9177db-64ea-4d0f-89d5-4a537c250d92', 'volume_name': 'volume-4d9177db-64ea-4d0f-89d5-4a537c250d92', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c43dbd9-4304-4603-bc80-56af1b1e3857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c43dbd9-4304-4603-bc80-56af1b1e3857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fee5f15-b842-49b6-8783-875514369cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Volume 4d9177db-64ea-4d0f-89d5-4a537c250d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d9177db-64ea-4d0f-89d5-4a537c250d92', 'volume_size': 1} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f49ebc7a-1be3-471a-8116-623f70400764,created_at=2026-09-04T03:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886457969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f49ebc7a-1be3-471a-8116-623f70400764,host='devstack@QuobyteHD#QuobyteHD',id=4d9177db-64ea-4d0f-89d5-4a537c250d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd61e8aaf344a13839a5b3488641fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:25Z,use_quota=True,user_id='e28e4242a8fa42f3b027d7ae1630ac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe590452-d262-4f5f-b6cc-239532778300),volume_type_id=fe590452-d262-4f5f-b6cc-239532778300)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Creating volume 4d9177db-64ea-4d0f-89d5-4a537c250d92 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:59:25 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:25 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 1073741824 Sep 04 05:59:25 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Flow 'volume_create_manager' (bcfc824e-d591-46ea-8ec1-8f5aa29c3b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50ddeae-9fef-4e5e-9940-bda51a739485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50ddeae-9fef-4e5e-9940-bda51a739485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1525739388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6725c9a1-8ee7-4086-b445-469f24a1b7fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d18d21db0ca748048a15cafa24302308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:25Z,use_quota=True,user_id='315802233b3a42f48143aea8677f29a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1c5e43-c619-48df-bd76-5f1916427f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1c5e43-c619-48df-bd76-5f1916427f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:25 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2d1949-c3b2-437c-8d52-999b898ba486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2d1949-c3b2-437c-8d52-999b898ba486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6725c9a1-8ee7-4086-b445-469f24a1b7fc', 'volume_name': 'volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feee75cf-6fe2-4e41-8c1f-cda09e075b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feee75cf-6fe2-4e41-8c1f-cda09e075b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4b7cac-c9e3-4b48-bc72-ffbedf60516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Volume 6725c9a1-8ee7-4086-b445-469f24a1b7fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc', 'volume_size': 1} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.453s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 05:59:25 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 1073741824" returned: 0 in 0.646s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:26 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 Sep 04 05:59:26 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:26 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1525739388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6725c9a1-8ee7-4086-b445-469f24a1b7fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d18d21db0ca748048a15cafa24302308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:25Z,use_quota=True,user_id='315802233b3a42f48143aea8677f29a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Creating volume 6725c9a1-8ee7-4086-b445-469f24a1b7fc {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:59:26 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fee5f15-b842-49b6-8783-875514369cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9177db-64ea-4d0f-89d5-4a537c250d92', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:26 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc 1073741824 Sep 04 05:59:26 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8eb41f8-5a46-45af-9e68-549c45a59499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Volume volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 (4d9177db-64ea-4d0f-89d5-4a537c250d92): created successfully Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8eb41f8-5a46-45af-9e68-549c45a59499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Flow 'volume_create_manager' (30e42465-d047-44c1-b23d-b814faa44ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a9bd80ad-b115-4162-9898-f23b4c097e87 tempest-GroupSnapshotsTest-755642967 None] Created volume successfully. Sep 04 05:59:26 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc 1073741824" returned: 0 in 0.464s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:26 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc Sep 04 05:59:26 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:27 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc" returned: 0 in 0.260s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4b7cac-c9e3-4b48-bc72-ffbedf60516f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2406c8-1576-431d-a356-c29125e2ef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:27 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Volume volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc (6725c9a1-8ee7-4086-b445-469f24a1b7fc): created successfully Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2406c8-1576-431d-a356-c29125e2ef9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Flow 'volume_create_manager' (bcfc824e-d591-46ea-8ec1-8f5aa29c3b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f0139573-0ef0-4dc7-bf3e-6dcc1afc727b tempest-VolumesTestJSON-1290984179 None] Created volume successfully. Sep 04 05:59:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] GroupSnapshot 30dfe489-eca8-4107-aaf0-64ed822c8fa7: creating. Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] Group snapshot 30dfe489-eca8-4107-aaf0-64ed822c8fa7: creating. {{(pid=87132) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Flow 'volume_create_manager' (c6a3e222-a3ec-429c-b714-c6bff0182678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4faa59c4-15f2-4dd9-9147-7fcd834ac43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4faa59c4-15f2-4dd9-9147-7fcd834ac43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-53618706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bf2650-9b2b-4569-aba6-368d7b74ab6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d18d21db0ca748048a15cafa24302308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:28Z,use_quota=True,user_id='315802233b3a42f48143aea8677f29a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a385d9fc-c5b4-492b-a980-1bd04cb606d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a385d9fc-c5b4-492b-a980-1bd04cb606d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f2bb77-a875-457b-bc2d-1971072d0276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f2bb77-a875-457b-bc2d-1971072d0276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84bf2650-9b2b-4569-aba6-368d7b74ab6b', 'volume_name': 'volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e78621-fc28-4468-ad14-16e8888dc9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e78621-fc28-4468-ad14-16e8888dc9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8283dad0-19f2-4f57-9543-71fdc5e91a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Volume 84bf2650-9b2b-4569-aba6-368d7b74ab6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b', 'volume_size': 1} Sep 04 05:59:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] Creating offline snapshot bc23781a-3fb7-4452-8f66-5746593e4ec3 of volume 4d9177db-64ea-4d0f-89d5-4a537c250d92 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 05:59:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[088725db-adf9-4282-aecf-29bb186b8337]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:28 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 Sep 04 05:59:28 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:28 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92" returned: 0 in 0.427s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:28 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 1G Sep 04 05:59:28 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:28 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 1G" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:28 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 Sep 04 05:59:28 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:29 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:29 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 05:59:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:29 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 Sep 04 05:59:29 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:29 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:29 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.info Sep 04 05:59:29 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:29 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.info" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:29 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 05:59:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:29 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.info Sep 04 05:59:29 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:30 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.info" returned: 0 in 0.274s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.170s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-53618706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bf2650-9b2b-4569-aba6-368d7b74ab6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d18d21db0ca748048a15cafa24302308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:28Z,use_quota=True,user_id='315802233b3a42f48143aea8677f29a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Creating volume 84bf2650-9b2b-4569-aba6-368d7b74ab6b {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:59:30 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:30 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b 1073741824 Sep 04 05:59:30 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0f418134-5a48-4617-a5b0-38d21aeb6b33 tempest-GroupSnapshotsTest-755642967 None] group_snapshot 30dfe489-eca8-4107-aaf0-64ed822c8fa7: created successfully Sep 04 05:59:30 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b 1073741824" returned: 0 in 0.550s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:30 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b Sep 04 05:59:30 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:31 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8283dad0-19f2-4f57-9543-71fdc5e91a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6b85c7-15b5-4d93-bb77-374e61314495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Volume volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b (84bf2650-9b2b-4569-aba6-368d7b74ab6b): created successfully Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6b85c7-15b5-4d93-bb77-374e61314495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Flow 'volume_create_manager' (c6a3e222-a3ec-429c-b714-c6bff0182678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cfc3a7fa-2d3e-4fd6-8d75-6a695eeaf434 tempest-VolumesTestJSON-1290984179 None] Created volume successfully. Sep 04 05:59:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] group_snapshot 30dfe489-eca8-4107-aaf0-64ed822c8fa7: deleting Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] group_snapshot 30dfe489-eca8-4107-aaf0-64ed822c8fa7: deleting {{(pid=87132) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-4d9177db-64ea-4d0f-89d5-4a537c250d92" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-4d9177db-64ea-4d0f-89d5-4a537c250d92" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-bc23781a-3fb7-4452-8f66-5746593e4ec3" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-bc23781a-3fb7-4452-8f66-5746593e4ec3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Deleting offline snapshot bc23781a-3fb7-4452-8f66-5746593e4ec3 of volume 4d9177db-64ea-4d0f-89d5-4a537c250d92 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] snapshot_file for this snap is: volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e907461-f452-4cc7-acf6-4c1ca53c764f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:31 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 Sep 04 05:59:31 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:31 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3" returned: 0 in 0.406s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d9177db-64ea-4d0f-89d5-4a537c250d92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0279af70-bdad-42dd-a043-15b6cf8916d6]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:31 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 Sep 04 05:59:31 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:32 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92" returned: 0 in 0.514s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:32 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 Sep 04 05:59:32 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:32 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3" returned: 0 in 0.427s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:32 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3 Sep 04 05:59:32 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:33 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92.bc23781a-3fb7-4452-8f66-5746593e4ec3" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-bc23781a-3fb7-4452-8f66-5746593e4ec3" released by "_delete_snapshot" :: held 1.759s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-4d9177db-64ea-4d0f-89d5-4a537c250d92" released by "delete_snapshot" :: held 1.796s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "cinder-84bf2650-9b2b-4569-aba6-368d7b74ab6b-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Lock "cinder-84bf2650-9b2b-4569-aba6-368d7b74ab6b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "cinder-quobyte-84bf2650-9b2b-4569-aba6-368d7b74ab6b" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Lock "cinder-quobyte-84bf2650-9b2b-4569-aba6-368d7b74ab6b" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:33 devstack cinder-volume[87132]: WARNING cinder.quota [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2036547498 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2036547498, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:59:33 devstack cinder-volume[87132]: WARNING cinder.quota [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2036547498 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2036547498, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:59:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93e2309-d30c-436f-8294-bef7276dd2b8]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:33 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] Created reservations ['765a2295-c151-4852-84b8-e4114fa490d8', '85481a4a-3a18-4d7e-9fc0-7fe92f405c3b', '42746ab2-6920-4f28-8e9a-f62226ac25e5', 'f1fd89c9-8e01-48f2-9f7a-e030dd1f24c0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:33 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b Sep 04 05:59:33 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b5fd4e1c-b2cd-4c7d-9f3e-c385f25858ae tempest-GroupSnapshotsTest-755642967 None] group_snapshot 30dfe489-eca8-4107-aaf0-64ed822c8fa7: deleted successfully Sep 04 05:59:33 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b" returned: 0 in 0.457s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:33 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b Sep 04 05:59:33 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:34 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "cinder-quobyte-4d9177db-64ea-4d0f-89d5-4a537c250d92" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84bf2650-9b2b-4569-aba6-368d7b74ab6b" returned: 0 in 0.290s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Lock "cinder-quobyte-84bf2650-9b2b-4569-aba6-368d7b74ab6b" released by "delete_volume" :: held 0.809s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-4d9177db-64ea-4d0f-89d5-4a537c250d92" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaf83c5-85f6-4b41-865f-6f56caaab5d2]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Created reservations ['5118b859-aac5-419e-a940-8deb900ddfd6', '4f7d569e-35c0-4c83-8e18-e6345ed3fef5', '9d0c0046-af72-4212-9fb0-c5bb2065fac8', 'b649c21d-4c52-4ba7-ad2a-04e3b82ebc60'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:34 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 Sep 04 05:59:34 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:34 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:59:34 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "cinder-6725c9a1-8ee7-4086-b445-469f24a1b7fc-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Lock "cinder-6725c9a1-8ee7-4086-b445-469f24a1b7fc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "cinder-quobyte-6725c9a1-8ee7-4086-b445-469f24a1b7fc" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Lock "cinder-quobyte-6725c9a1-8ee7-4086-b445-469f24a1b7fc" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7906e969-bf84-4808-aa9e-c8f04b0b21fd]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:34 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:59:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Deleted volume successfully. Sep 04 05:59:34 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92" returned: 0 in 0.503s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c334b5dd-28d4-4f7a-bf01-ab4a07cb6f90 tempest-VolumesTestJSON-1290984179 None] Lock "cinder-84bf2650-9b2b-4569-aba6-368d7b74ab6b-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:34 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92 Sep 04 05:59:34 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:34 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc Sep 04 05:59:34 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:34 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4d9177db-64ea-4d0f-89d5-4a537c250d92" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Lock "cinder-quobyte-4d9177db-64ea-4d0f-89d5-4a537c250d92" released by "delete_volume" :: held 0.920s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:34 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc" returned: 0 in 0.484s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:35 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc Sep 04 05:59:35 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Created reservations ['0c88ad76-19bb-46b3-a85d-dca5daca3518'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:35 devstack cinder-volume[87132]: WARNING cinder.quota [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2036547498 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2036547498, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Created reservations ['09d3e4f9-e22e-489f-8dbb-057c5ef0ea22', '90fe9943-339d-465d-991b-4b3c4b01960a', 'aa2706d4-64e9-4988-a78a-794d51fd83b2', '56f9d864-b8fb-44bc-a4bf-ce6fe7e13937'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:35 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6725c9a1-8ee7-4086-b445-469f24a1b7fc" returned: 0 in 0.318s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:35 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:59:35 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Lock "cinder-quobyte-6725c9a1-8ee7-4086-b445-469f24a1b7fc" released by "delete_volume" :: held 0.864s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Created reservations ['47255124-e5d8-44b3-ac7f-8b6026b98052', '17d664c3-18cb-43e3-bac5-f33867ec9384', '35c347c2-5c61-4ed2-b83b-fa6a48dcdc0a', 'ec9bc6a6-ef8d-4821-bcfc-113ed354450c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:35 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:59:35 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:35 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.283s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:59:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-df48ebf8-861a-4008-968d-a0dc2b1899d7 tempest-GroupSnapshotsTest-755642967 None] Delete group completed successfully. Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "cinder-56169952-d93e-4c52-9481-ac9c339cc57f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Lock "cinder-56169952-d93e-4c52-9481-ac9c339cc57f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "cinder-quobyte-56169952-d93e-4c52-9481-ac9c339cc57f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Lock "cinder-quobyte-56169952-d93e-4c52-9481-ac9c339cc57f" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[88478b72-f03e-461d-821b-520cb8a6f2ff]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-56169952-d93e-4c52-9481-ac9c339cc57f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:35 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.323s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:59:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Deleted volume successfully. Sep 04 05:59:35 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-56169952-d93e-4c52-9481-ac9c339cc57f Sep 04 05:59:35 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd233300-60ec-4b18-86c0-969ffbc079f8 tempest-VolumesTestJSON-1290984179 None] Lock "cinder-6725c9a1-8ee7-4086-b445-469f24a1b7fc-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:36 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-56169952-d93e-4c52-9481-ac9c339cc57f" returned: 0 in 0.461s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-56169952-d93e-4c52-9481-ac9c339cc57f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:36 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-56169952-d93e-4c52-9481-ac9c339cc57f Sep 04 05:59:36 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:36 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-56169952-d93e-4c52-9481-ac9c339cc57f" returned: 0 in 0.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Lock "cinder-quobyte-56169952-d93e-4c52-9481-ac9c339cc57f" released by "delete_volume" :: held 0.832s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Created reservations ['035ec851-78e9-4fd1-bac3-b4ff50eacba6', 'bee688ef-bdee-4a3e-a3b3-e12c1ef6a9eb', '82ef71d8-864f-4fa2-a2d6-ed0b48cee808', '56bd447d-72e6-44f5-b240-e2bf47b0ab64'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:36 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:59:36 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:37 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.421s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:59:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Deleted volume successfully. Sep 04 05:59:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3cc9a96-db79-4380-849b-74643e36a5e3 tempest-VolumesTestJSON-1290984179 None] Lock "cinder-56169952-d93e-4c52-9481-ac9c339cc57f-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:43 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=149,cinder:UPDATE=178,cinder:INSERT=37,cinder:DELETE=8 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:59:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f57d0ee5-0dbf-44a8-b234-fe0def941d1a tempest-GroupSnapshotsV319Test-875138448 None] Group tempest-GroupSnapshotsV319Test-Group-1479646922: creating Sep 04 05:59:43 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:INSERT=43,cinder:UPDATE=160,cinder:SELECT=140,cinder:DELETE=7 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 05:59:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f57d0ee5-0dbf-44a8-b234-fe0def941d1a tempest-GroupSnapshotsV319Test-875138448 None] Group tempest-GroupSnapshotsV319Test-Group-1479646922: created successfully Sep 04 05:59:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f57d0ee5-0dbf-44a8-b234-fe0def941d1a tempest-GroupSnapshotsV319Test-875138448 None] Create group completed successfully. Sep 04 05:59:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e1edbd33-ccac-4389-bfba-86763fbfd770 tempest-GroupsV320Test-132317718 None] Group tempest-GroupsV320Test-Group-953140097: creating Sep 04 05:59:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e1edbd33-ccac-4389-bfba-86763fbfd770 tempest-GroupsV320Test-132317718 None] Group tempest-GroupsV320Test-Group-953140097: created successfully Sep 04 05:59:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e1edbd33-ccac-4389-bfba-86763fbfd770 tempest-GroupsV320Test-132317718 None] Create group completed successfully. Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Flow 'volume_create_manager' (99d172ee-6a08-49cf-a55a-6cb7ded74e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfd209b-d5d7-4d96-947d-b3f871f29e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfd209b-d5d7-4d96-947d-b3f871f29e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-390845119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57103799-a50a-4527-beb2-789e613f1a4d,host='devstack@QuobyteHD#QuobyteHD',id=af4bb342-42c1-4604-8cfb-eef86bba6eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26d3e1903f44d4799b56a40fb28c4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:46Z,use_quota=True,user_id='8173099edd1c46f48f587deb70116239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5e496c4-96c4-4bc0-832e-a0527e742df4),volume_type_id=c5e496c4-96c4-4bc0-832e-a0527e742df4)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee1a556-d8cc-41db-9a78-56250c54c4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee1a556-d8cc-41db-9a78-56250c54c4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f254d47-1e6f-4813-8e07-18ee843d7853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f254d47-1e6f-4813-8e07-18ee843d7853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af4bb342-42c1-4604-8cfb-eef86bba6eab', 'volume_name': 'volume-af4bb342-42c1-4604-8cfb-eef86bba6eab', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b54ae0d-e651-40b0-8e11-9d484c6c948d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b54ae0d-e651-40b0-8e11-9d484c6c948d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8003bf-3e43-4b06-b3ef-d69210848978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:46 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Volume af4bb342-42c1-4604-8cfb-eef86bba6eab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af4bb342-42c1-4604-8cfb-eef86bba6eab', 'volume_size': 1} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57103799-a50a-4527-beb2-789e613f1a4d,created_at=2026-09-04T03:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-390845119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57103799-a50a-4527-beb2-789e613f1a4d,host='devstack@QuobyteHD#QuobyteHD',id=af4bb342-42c1-4604-8cfb-eef86bba6eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26d3e1903f44d4799b56a40fb28c4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:46Z,use_quota=True,user_id='8173099edd1c46f48f587deb70116239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5e496c4-96c4-4bc0-832e-a0527e742df4),volume_type_id=c5e496c4-96c4-4bc0-832e-a0527e742df4)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Creating volume af4bb342-42c1-4604-8cfb-eef86bba6eab {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:59:46 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:46 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab 1073741824 Sep 04 05:59:46 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-824214df-7b09-4e28-b19e-44c62fd5bea1 tempest-GroupsV320Test-132317718 None] Created reservations ['bf0c41fc-433f-4a2a-90d0-b810f7db5f41'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:46 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab 1073741824" returned: 0 in 0.720s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:46 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab Sep 04 05:59:46 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-824214df-7b09-4e28-b19e-44c62fd5bea1 tempest-GroupsV320Test-132317718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-824214df-7b09-4e28-b19e-44c62fd5bea1 tempest-GroupsV320Test-132317718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-824214df-7b09-4e28-b19e-44c62fd5bea1 tempest-GroupsV320Test-132317718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-824214df-7b09-4e28-b19e-44c62fd5bea1 tempest-GroupsV320Test-132317718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-824214df-7b09-4e28-b19e-44c62fd5bea1 tempest-GroupsV320Test-132317718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-824214df-7b09-4e28-b19e-44c62fd5bea1 tempest-GroupsV320Test-132317718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:46 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:59:46 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:47 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:59:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8003bf-3e43-4b06-b3ef-d69210848978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af4bb342-42c1-4604-8cfb-eef86bba6eab', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6421ed-82cf-49c6-9165-60b06d6ee0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:47 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Volume volume-af4bb342-42c1-4604-8cfb-eef86bba6eab (af4bb342-42c1-4604-8cfb-eef86bba6eab): created successfully Sep 04 05:59:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6421ed-82cf-49c6-9165-60b06d6ee0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Flow 'volume_create_manager' (99d172ee-6a08-49cf-a55a-6cb7ded74e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-824214df-7b09-4e28-b19e-44c62fd5bea1 tempest-GroupsV320Test-132317718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.349s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-824214df-7b09-4e28-b19e-44c62fd5bea1 tempest-GroupsV320Test-132317718 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:59:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-824214df-7b09-4e28-b19e-44c62fd5bea1 tempest-GroupsV320Test-132317718 None] Delete group completed successfully. Sep 04 05:59:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e7dee96b-11c1-43e1-9e9a-e7b014d581ea tempest-GroupSnapshotsV319Test-875138448 None] Created volume successfully. Sep 04 05:59:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] GroupSnapshot f4c3e49d-cc5e-453b-ab04-7b12b057495d: creating. Sep 04 05:59:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] Group snapshot f4c3e49d-cc5e-453b-ab04-7b12b057495d: creating. {{(pid=87132) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 05:59:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] Creating offline snapshot 4d1c6095-e11c-49f2-9dc1-36513bb71202 of volume af4bb342-42c1-4604-8cfb-eef86bba6eab {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 05:59:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fd0eb0-0ddf-4742-b43b-9430cf3c6716]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:49 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab Sep 04 05:59:49 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:49 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:49 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 1G Sep 04 05:59:49 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:50 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 1G" returned: 0 in 0.676s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af4bb342-42c1-4604-8cfb-eef86bba6eab -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:50 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af4bb342-42c1-4604-8cfb-eef86bba6eab -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 Sep 04 05:59:50 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:50 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af4bb342-42c1-4604-8cfb-eef86bba6eab -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202" returned: 0 in 0.412s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:50 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 05:59:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:50 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 Sep 04 05:59:50 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:50 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:50 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.info Sep 04 05:59:50 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:51 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.info" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:51 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 05:59:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:51 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.info Sep 04 05:59:51 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:51 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.info" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1a73fce2-5ca9-4b75-bef4-8cc1aac8197e tempest-GroupSnapshotsV319Test-875138448 None] group_snapshot f4c3e49d-cc5e-453b-ab04-7b12b057495d: created successfully Sep 04 05:59:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] group_snapshot f4c3e49d-cc5e-453b-ab04-7b12b057495d: deleting Sep 04 05:59:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] group_snapshot f4c3e49d-cc5e-453b-ab04-7b12b057495d: deleting {{(pid=87132) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 05:59:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Acquiring lock "cinder-quobyte-af4bb342-42c1-4604-8cfb-eef86bba6eab" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Lock "cinder-quobyte-af4bb342-42c1-4604-8cfb-eef86bba6eab" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Acquiring lock "cinder-quobyte-4d1c6095-e11c-49f2-9dc1-36513bb71202" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Lock "cinder-quobyte-4d1c6095-e11c-49f2-9dc1-36513bb71202" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Deleting offline snapshot 4d1c6095-e11c-49f2-9dc1-36513bb71202 of volume af4bb342-42c1-4604-8cfb-eef86bba6eab {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 05:59:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] snapshot_file for this snap is: volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 05:59:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e7e339-49d8-4970-85df-b91f8dce50be]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:53 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 Sep 04 05:59:53 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:53 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202" returned: 0 in 0.429s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af4bb342-42c1-4604-8cfb-eef86bba6eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 05:59:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5204fb-6762-4b96-9d4b-155d260935c8]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:53 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab Sep 04 05:59:53 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:53 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab" returned: 0 in 0.450s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:53 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 Sep 04 05:59:53 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Flow 'volume_create_manager' (13ee99ee-e8bb-423f-8ed9-80b0b19bd45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a67dff0-0ae6-4166-927f-72050e2da158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a67dff0-0ae6-4166-927f-72050e2da158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1187462918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034a841b-d84d-4c43-9742-b44c7f7cc148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f237eff2ec9e45a88c222ef8ef415f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:54Z,use_quota=True,user_id='354b8d4e330b45f8a5f70c9c4857d300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b693eb-88e8-458c-be21-9a3569508f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b693eb-88e8-458c-be21-9a3569508f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c082ea0d-bf9f-45df-b0b8-d7847594f945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c082ea0d-bf9f-45df-b0b8-d7847594f945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034a841b-d84d-4c43-9742-b44c7f7cc148', 'volume_name': 'volume-034a841b-d84d-4c43-9742-b44c7f7cc148', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e09b8f5-9f75-4221-b1eb-2447109cbba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e09b8f5-9f75-4221-b1eb-2447109cbba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d159d36-c646-4332-afcb-0eba61dd382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:54 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Volume 034a841b-d84d-4c43-9742-b44c7f7cc148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034a841b-d84d-4c43-9742-b44c7f7cc148', 'volume_size': 1} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T03:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1187462918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034a841b-d84d-4c43-9742-b44c7f7cc148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f237eff2ec9e45a88c222ef8ef415f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:54Z,use_quota=True,user_id='354b8d4e330b45f8a5f70c9c4857d300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Creating volume 034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 05:59:54 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:54 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:54 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 1073741824 Sep 04 05:59:54 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:54 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202 Sep 04 05:59:54 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:54 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab.4d1c6095-e11c-49f2-9dc1-36513bb71202" returned: 0 in 0.313s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Lock "cinder-quobyte-4d1c6095-e11c-49f2-9dc1-36513bb71202" released by "_delete_snapshot" :: held 1.823s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Lock "cinder-quobyte-af4bb342-42c1-4604-8cfb-eef86bba6eab" released by "delete_snapshot" :: held 1.871s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:54 devstack cinder-volume[87132]: WARNING cinder.quota [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2070023033 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2070023033, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:59:54 devstack cinder-volume[87132]: WARNING cinder.quota [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2070023033 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2070023033, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] Created reservations ['dbe65e32-73d7-45f1-b4ae-8d7b0aa7dba8', '656cb418-61ab-4cec-828e-1692d8c2def3', '6cbbb209-e079-421e-9076-8ac7d3da6f20', '2119f9d5-0996-4fa7-8345-5c7d60ca5c5f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:54 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7ef2dac1-ea4f-447a-9012-aa6f5fb603ca tempest-GroupSnapshotsV319Test-875138448 None] group_snapshot f4c3e49d-cc5e-453b-ab04-7b12b057495d: deleted successfully Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 1073741824" returned: 0 in 0.549s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:55 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 Sep 04 05:59:55 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:55 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148" returned: 0 in 0.254s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d159d36-c646-4332-afcb-0eba61dd382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034a841b-d84d-4c43-9742-b44c7f7cc148', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c0c64b-26b4-40f3-b4fb-31a36b4dd54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 05:59:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Volume volume-034a841b-d84d-4c43-9742-b44c7f7cc148 (034a841b-d84d-4c43-9742-b44c7f7cc148): created successfully Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c0c64b-26b4-40f3-b4fb-31a36b4dd54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Flow 'volume_create_manager' (13ee99ee-e8bb-423f-8ed9-80b0b19bd45a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 05:59:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7f5b5185-1219-4db9-be52-7e6603cfa8b3 tempest-SnapshotsActionsTest-1091175002 None] Created volume successfully. Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Acquiring lock "cinder-quobyte-af4bb342-42c1-4604-8cfb-eef86bba6eab" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Lock "cinder-quobyte-af4bb342-42c1-4604-8cfb-eef86bba6eab" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3359872-5a22-4e0e-9771-6b8a69517944]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:55 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab Sep 04 05:59:55 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:55 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:55 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab Sep 04 05:59:55 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:56 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-af4bb342-42c1-4604-8cfb-eef86bba6eab" returned: 0 in 0.248s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Lock "cinder-quobyte-af4bb342-42c1-4604-8cfb-eef86bba6eab" released by "delete_volume" :: held 0.685s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Created reservations ['4de30441-ba75-4cd7-bc15-2fa9e44dc82f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:56 devstack cinder-volume[87132]: WARNING cinder.quota [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2070023033 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2070023033, it is now deprecated. Please use the default quota class for default quota. Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Created reservations ['5db316b6-9262-4ef8-8866-30136aa3a043', 'a01538f9-5deb-4c7c-b598-7f5f09871e73', '0c85dbb0-31f2-4242-b861-236ab8e3de0a', '5b824f7a-0556-400f-8a1b-c7e900a1c297'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:56 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 05:59:56 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] Creating offline snapshot b45b2045-4418-4ad6-b626-55945a6a6886 of volume 034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a140c9-69ce-414e-b7cf-c72a016ec840]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:56 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 Sep 04 05:59:56 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:56 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.314s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:56 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 05:59:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-02f7a2be-fd60-4a80-bfbe-4c2b44346ce5 tempest-GroupSnapshotsV319Test-875138448 None] Delete group completed successfully. Sep 04 05:59:57 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:57 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 1G Sep 04 05:59:57 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:57 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 1G" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:57 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 05:59:57 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:57 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.337s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:57 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 is being set with open permissions: ugo+rw Sep 04 05:59:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:57 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 05:59:57 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:58 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:58 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.info Sep 04 05:59:58 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:58 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.info" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:58 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.info is being set with open permissions: ugo+rw Sep 04 05:59:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 05:59:58 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.info Sep 04 05:59:58 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 05:59:58 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Sep 04 05:59:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.info" returned: 0 in 0.292s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 05:59:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 05:59:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-27c3be13-1eca-429e-b4de-26375d2a4e2e tempest-SnapshotsActionsTest-1091175002 None] Create snapshot completed successfully Sep 04 06:00:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] Creating offline snapshot 6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 of volume 034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:00:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[451c9144-dc9b-44f7-9a31-ac38a35d066d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:00 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 06:00:00 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:01 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.412s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:01 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 1G Sep 04 06:00:01 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:01 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 1G" returned: 0 in 0.572s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:01 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 Sep 04 06:00:01 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:02 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43" returned: 0 in 0.344s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:02 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 is being set with open permissions: ugo+rw Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:02 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 Sep 04 06:00:02 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:02 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.740s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-12867f9f-9d02-4698-9572-bf371a499aa6 tempest-SnapshotsActionsTest-1091175002 None] Create snapshot completed successfully Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Acquiring lock "cinder-6520f7d8-e3fa-4d15-bd0a-bf5e539fca43-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-6520f7d8-e3fa-4d15-bd0a-bf5e539fca43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Acquiring lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Acquiring lock "cinder-quobyte-6520f7d8-e3fa-4d15-bd0a-bf5e539fca43" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-6520f7d8-e3fa-4d15-bd0a-bf5e539fca43" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Deleting offline snapshot 6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 of volume 034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] snapshot_file for this snap is: volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0461585f-322e-45c5-964a-a7cbe98933c2]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:03 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 Sep 04 06:00:03 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:03 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43" returned: 0 in 0.385s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[148e5606-e5db-41e2-b15f-ffb426287da0]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:03 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 06:00:03 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:03 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.452s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:03 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 Sep 04 06:00:03 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:04 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43" returned: 0 in 0.466s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:04 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43 Sep 04 06:00:04 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:04 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.6520f7d8-e3fa-4d15-bd0a-bf5e539fca43" returned: 0 in 0.286s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-6520f7d8-e3fa-4d15-bd0a-bf5e539fca43" released by "_delete_snapshot" :: held 1.702s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" released by "delete_snapshot" :: held 1.723s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:04 devstack cinder-volume[87132]: WARNING cinder.quota [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:00:04 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Created reservations ['aabcba21-c8cb-428a-bc94-a7785978bfc4', 'ef3ae5ff-101d-40de-8cb2-1e6bd88b4733', '5a9fa1df-f7e5-4aa5-81d0-d3cd8e2740df', '944faada-7258-4892-9031-5d7af6000ff1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Delete snapshot completed successfully. Sep 04 06:00:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f2bf2850-1ac7-4b18-80db-2626a6457ce2 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-6520f7d8-e3fa-4d15-bd0a-bf5e539fca43-delete_snapshot" released by "delete_snapshot" :: held 1.886s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] Creating offline snapshot 7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 of volume 034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:00:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e790bd-20ac-4163-b153-8c79c551018d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:05 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 06:00:05 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:05 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.457s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:05 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 1G Sep 04 06:00:05 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:00:06 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Flow 'volume_create_manager' (3c808f78-727f-4a08-ab07-f980f870f40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865d3887-6405-4af3-85f5-0af3ff8fe538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 1G" returned: 0 in 0.587s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:06 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865d3887-6405-4af3-85f5-0af3ff8fe538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1299268022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94b645b-dfc9-46ec-9fd9-f1bec719b2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d06b0a8d0b4e8a9bbb432b2fbe086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:06Z,use_quota=True,user_id='ecf22ca64c0f4ebdb749d57d11d01a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:06 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924878b7-9792-43e5-9fad-e42269949132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924878b7-9792-43e5-9fad-e42269949132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ef2def-fa3b-4e08-ab48-2c2ab056f436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ef2def-fa3b-4e08-ab48-2c2ab056f436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94b645b-dfc9-46ec-9fd9-f1bec719b2dd', 'volume_name': 'volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17664bcb-f190-4968-a161-9fa0396809ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17664bcb-f190-4968-a161-9fa0396809ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a233d2-8c04-4891-b49c-6045e72dca2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Volume a94b645b-dfc9-46ec-9fd9-f1bec719b2dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd', 'volume_size': 1} Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:06 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2" returned: 0 in 0.317s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:06 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 is being set with open permissions: ugo+rw Sep 04 06:00:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:06 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 Sep 04 06:00:06 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:07 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2" returned: 0 in 0.268s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.749s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1299268022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94b645b-dfc9-46ec-9fd9-f1bec719b2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d06b0a8d0b4e8a9bbb432b2fbe086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:06Z,use_quota=True,user_id='ecf22ca64c0f4ebdb749d57d11d01a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Creating volume a94b645b-dfc9-46ec-9fd9-f1bec719b2dd {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:00:07 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:07 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd 1073741824 Sep 04 06:00:07 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-50a8c6ba-89db-4333-a8a1-da1457be74ef tempest-SnapshotsActionsTest-1091175002 None] Create snapshot completed successfully Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Acquiring lock "cinder-7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Acquiring lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:07 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd 1073741824" returned: 0 in 0.537s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Acquiring lock "cinder-quobyte-7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Deleting offline snapshot 7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 of volume 034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] snapshot_file for this snap is: volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0c68d1-d0e0-4b0d-adcd-93516d2ee4c7]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:07 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd Sep 04 06:00:07 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:07 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 Sep 04 06:00:07 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8753f1fc-7e66-4831-926e-6bb032046f02 tempest-GroupsTest-1103203460 None] Group tempest-Group1-1668116869: creating Sep 04 06:00:08 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a233d2-8c04-4891-b49c-6045e72dca2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf824d1-df77-476f-bb9f-73ce810c624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Volume volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd (a94b645b-dfc9-46ec-9fd9-f1bec719b2dd): created successfully Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf824d1-df77-476f-bb9f-73ce810c624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Flow 'volume_create_manager' (3c808f78-727f-4a08-ab07-f980f870f40a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:00:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8753f1fc-7e66-4831-926e-6bb032046f02 tempest-GroupsTest-1103203460 None] Group tempest-Group1-1668116869: created successfully Sep 04 06:00:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8753f1fc-7e66-4831-926e-6bb032046f02 tempest-GroupsTest-1103203460 None] Create group completed successfully. Sep 04 06:00:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-532830bd-3dc8-45c2-bd51-518f0a846d27 tempest-AttachVolumeNegativeTest-1175679777 None] Created volume successfully. Sep 04 06:00:08 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2" returned: 0 in 0.410s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17c35fa-573e-43df-94e5-f25af7a6f925]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:08 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 06:00:08 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:08 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:08 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 Sep 04 06:00:08 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:09 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2" returned: 0 in 0.461s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:09 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2 Sep 04 06:00:09 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-9e42159a-363a-4c4e-9796-8150840a2b5e req-88c19904-f15a-492a-913f-3790fd14b1b3 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-9e42159a-363a-4c4e-9796-8150840a2b5e req-88c19904-f15a-492a-913f-3790fd14b1b3 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-9e42159a-363a-4c4e-9796-8150840a2b5e req-88c19904-f15a-492a-913f-3790fd14b1b3 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-9e42159a-363a-4c4e-9796-8150840a2b5e req-88c19904-f15a-492a-913f-3790fd14b1b3 tempest-AttachVolumeNegativeTest-1175679777 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9bc6e73-4511-464c-97b5-1ad15ce2cdc2', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:00:09 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2" returned: 0 in 0.288s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2" released by "_delete_snapshot" :: held 1.651s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a2267241-9120-4124-b00c-e3b6d299d768 tempest-GroupsTest-1103203460 None] Group tempest-Group2-1138925299: creating Sep 04 06:00:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" released by "delete_snapshot" :: held 1.688s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-9e42159a-363a-4c4e-9796-8150840a2b5e req-88c19904-f15a-492a-913f-3790fd14b1b3 tempest-AttachVolumeNegativeTest-1175679777 None] attachment_update completed successfully. Sep 04 06:00:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a2267241-9120-4124-b00c-e3b6d299d768 tempest-GroupsTest-1103203460 None] Group tempest-Group2-1138925299: created successfully Sep 04 06:00:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a2267241-9120-4124-b00c-e3b6d299d768 tempest-GroupsTest-1103203460 None] Create group completed successfully. Sep 04 06:00:09 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Created reservations ['cf7de43a-c0ab-460f-8260-1005d3cf7e3e', '0e36b202-c380-4542-9b4f-5c6424ce0e5d', 'd04b2646-19b0-4097-a71c-5b42324f4a0e', '41eb1214-1c40-4442-a39c-d487708fc15d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Delete snapshot completed successfully. Sep 04 06:00:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-631ed256-77ff-43c5-a650-a6e04b2334d3 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-7d73bbc4-cdd6-4a5a-bb94-91b5b4b7a7f2-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] Creating offline snapshot c235c783-cb97-4645-84f3-f69237c4b2b8 of volume 034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:00:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58ec640-e573-4203-b4b9-2b1a6b6da437]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:10 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 06:00:10 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:10 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.408s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:10 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 1G Sep 04 06:00:10 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Flow 'volume_create_manager' (045f4b60-3745-4654-ac73-a74c0445a417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d8fd8e-cf87-4d27-9a95-5219026ff3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d8fd8e-cf87-4d27-9a95-5219026ff3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2135061682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a63eb5e7-f031-48c0-86ad-73da3013c4d8,host='devstack@QuobyteHD#QuobyteHD',id=33b1a733-730b-4299-90c8-498c9a4f59af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17256e03094b423c8240ec42b99dd44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:11Z,use_quota=True,user_id='f77cb41dcbec4bf89888a4fb16f77f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fef2f36-143e-4c4d-8b1d-e23c51da7ffd),volume_type_id=2fef2f36-143e-4c4d-8b1d-e23c51da7ffd)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e7d032-5812-4435-9a5c-97c4b9443fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e7d032-5812-4435-9a5c-97c4b9443fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc10bdd3-3483-4292-b1ff-66629751df06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc10bdd3-3483-4292-b1ff-66629751df06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b1a733-730b-4299-90c8-498c9a4f59af', 'volume_name': 'volume-33b1a733-730b-4299-90c8-498c9a4f59af', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd884d2-8ea3-451a-afc6-aef803a9e276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd884d2-8ea3-451a-afc6-aef803a9e276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e43af67-f498-4a05-9786-63ab6939e970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Volume 33b1a733-730b-4299-90c8-498c9a4f59af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b1a733-730b-4299-90c8-498c9a4f59af', 'volume_size': 1} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:11 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 1G" returned: 0 in 0.552s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:11 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 Sep 04 06:00:11 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:11 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:11 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 is being set with open permissions: ugo+rw Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:11 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 Sep 04 06:00:11 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:11 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8" returned: 0 in 0.272s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.658s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a63eb5e7-f031-48c0-86ad-73da3013c4d8,created_at=2026-09-04T04:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2135061682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a63eb5e7-f031-48c0-86ad-73da3013c4d8,host='devstack@QuobyteHD#QuobyteHD',id=33b1a733-730b-4299-90c8-498c9a4f59af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17256e03094b423c8240ec42b99dd44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:11Z,use_quota=True,user_id='f77cb41dcbec4bf89888a4fb16f77f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fef2f36-143e-4c4d-8b1d-e23c51da7ffd),volume_type_id=2fef2f36-143e-4c4d-8b1d-e23c51da7ffd)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Creating volume 33b1a733-730b-4299-90c8-498c9a4f59af {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:00:11 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:00:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b1a733-730b-4299-90c8-498c9a4f59af 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:11 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b1a733-730b-4299-90c8-498c9a4f59af 1073741824 Sep 04 06:00:11 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2df530cf-6deb-4ae2-a600-041f76bb6405 tempest-SnapshotsActionsTest-1091175002 None] Create snapshot completed successfully Sep 04 06:00:12 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b1a733-730b-4299-90c8-498c9a4f59af 1073741824" returned: 0 in 0.626s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Acquiring lock "cinder-c235c783-cb97-4645-84f3-f69237c4b2b8-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-c235c783-cb97-4645-84f3-f69237c4b2b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Acquiring lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b1a733-730b-4299-90c8-498c9a4f59af {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Acquiring lock "cinder-quobyte-c235c783-cb97-4645-84f3-f69237c4b2b8" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:12 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b1a733-730b-4299-90c8-498c9a4f59af Sep 04 06:00:12 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-c235c783-cb97-4645-84f3-f69237c4b2b8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Deleting offline snapshot c235c783-cb97-4645-84f3-f69237c4b2b8 of volume 034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] snapshot_file for this snap is: volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37ef7bb-f150-4909-b5bb-a261b9293d10]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:12 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 Sep 04 06:00:12 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:12 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b1a733-730b-4299-90c8-498c9a4f59af" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e43af67-f498-4a05-9786-63ab6939e970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b1a733-730b-4299-90c8-498c9a4f59af', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8205c4ad-a406-4407-b0d9-7c72eb47dcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Volume volume-33b1a733-730b-4299-90c8-498c9a4f59af (33b1a733-730b-4299-90c8-498c9a4f59af): created successfully Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8205c4ad-a406-4407-b0d9-7c72eb47dcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Flow 'volume_create_manager' (045f4b60-3745-4654-ac73-a74c0445a417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:00:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-aa431746-2c0b-4ac6-bd67-049327f64aea tempest-GroupsTest-1103203460 None] Created volume successfully. Sep 04 06:00:12 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff64a4c-861a-4c52-8d13-0b3c0adbd349]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:13 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 06:00:13 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:13 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.389s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:13 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 Sep 04 06:00:13 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:13 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8" returned: 0 in 0.547s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:13 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8 Sep 04 06:00:13 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:14 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.c235c783-cb97-4645-84f3-f69237c4b2b8" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-c235c783-cb97-4645-84f3-f69237c4b2b8" released by "_delete_snapshot" :: held 1.698s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" released by "delete_snapshot" :: held 1.735s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Acquiring lock "cinder-quobyte-33b1a733-730b-4299-90c8-498c9a4f59af" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Lock "cinder-quobyte-33b1a733-730b-4299-90c8-498c9a4f59af" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd88d129-41ca-4b9b-ab51-0e8bdd0e638d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b1a733-730b-4299-90c8-498c9a4f59af {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:14 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Created reservations ['5205676e-5e10-4311-8a06-e4610922f864', '8b6bcfa8-7e5b-4013-a363-ca10911f3f45', 'd370319d-ca05-4550-91a6-4cede2e5aab8', '45b8503d-1013-40e9-b8aa-9ff8e14945b5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:14 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b1a733-730b-4299-90c8-498c9a4f59af Sep 04 06:00:14 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Delete snapshot completed successfully. Sep 04 06:00:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9b1dae0-36cd-4b0c-bb0e-bc91457d95ac tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-c235c783-cb97-4645-84f3-f69237c4b2b8-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:14 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b1a733-730b-4299-90c8-498c9a4f59af" returned: 0 in 0.563s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b1a733-730b-4299-90c8-498c9a4f59af {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:14 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b1a733-730b-4299-90c8-498c9a4f59af Sep 04 06:00:14 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] Creating offline snapshot 64592ef6-6fc6-4751-a28d-33e6b037a1db of volume 034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[868ccb8a-a8ba-4ea1-baa2-30a6c286453a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:15 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b1a733-730b-4299-90c8-498c9a4f59af" returned: 0 in 0.416s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Lock "cinder-quobyte-33b1a733-730b-4299-90c8-498c9a4f59af" released by "delete_volume" :: held 1.036s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:15 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 06:00:15 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Created reservations ['8f8e7141-f4f4-467b-af22-c35ee93c3b90'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:15 devstack cinder-volume[87132]: WARNING cinder.quota [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1658048185 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1658048185, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:00:15 devstack cinder-volume[87132]: WARNING cinder.quota [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1658048185 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1658048185, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Created reservations ['11ed83ec-ac7c-40d0-9148-07de708fe3f7', '6dde816b-7cf5-47a9-b106-dddcf0c0beff', '7b7190d2-0d4b-4cc6-8255-a2fcde60ffb5', '2f799058-6df3-4000-98da-32c48050bf5a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:15 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:15 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:00:15 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:15 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db 1G Sep 04 06:00:15 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:16 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.326s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:16 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:00:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1390acb7-b935-4612-983b-3ac2527a8a37 tempest-GroupsTest-1103203460 None] Delete group completed successfully. Sep 04 06:00:16 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db 1G" returned: 0 in 0.633s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:16 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db Sep 04 06:00:16 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:16 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:16 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db is being set with open permissions: ugo+rw Sep 04 06:00:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:16 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db Sep 04 06:00:16 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:17 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c46ae970-8133-40b0-bcde-b0146c478f42 tempest-GroupsTest-1103203460 None] Created reservations ['cf3131a3-395d-4d21-894f-c44efdbe0baf'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:17 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c46ae970-8133-40b0-bcde-b0146c478f42 tempest-GroupsTest-1103203460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c46ae970-8133-40b0-bcde-b0146c478f42 tempest-GroupsTest-1103203460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c46ae970-8133-40b0-bcde-b0146c478f42 tempest-GroupsTest-1103203460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c46ae970-8133-40b0-bcde-b0146c478f42 tempest-GroupsTest-1103203460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c46ae970-8133-40b0-bcde-b0146c478f42 tempest-GroupsTest-1103203460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c46ae970-8133-40b0-bcde-b0146c478f42 tempest-GroupsTest-1103203460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:17 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:00:17 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cdc25052-3f6f-4135-9ac5-0889425e633b tempest-SnapshotsActionsTest-1091175002 None] Create snapshot completed successfully Sep 04 06:00:17 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c46ae970-8133-40b0-bcde-b0146c478f42 tempest-GroupsTest-1103203460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:17 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c46ae970-8133-40b0-bcde-b0146c478f42 tempest-GroupsTest-1103203460 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:00:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c46ae970-8133-40b0-bcde-b0146c478f42 tempest-GroupsTest-1103203460 None] Delete group completed successfully. Sep 04 06:00:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Acquiring lock "cinder-64592ef6-6fc6-4751-a28d-33e6b037a1db-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-64592ef6-6fc6-4751-a28d-33e6b037a1db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Acquiring lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Acquiring lock "cinder-quobyte-64592ef6-6fc6-4751-a28d-33e6b037a1db" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-64592ef6-6fc6-4751-a28d-33e6b037a1db" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Deleting offline snapshot 64592ef6-6fc6-4751-a28d-33e6b037a1db of volume 034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:00:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] snapshot_file for this snap is: volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:00:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeb0a8d-d531-42d6-ba32-6432b483f81a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:18 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db Sep 04 06:00:18 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c476a61f-5a5f-4e4b-9b44-723314c0647b tempest-GroupsTest-1103203460 None] Group tempest-GroupsTest-Group-1999149924: creating Sep 04 06:00:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c476a61f-5a5f-4e4b-9b44-723314c0647b tempest-GroupsTest-1103203460 None] Group tempest-GroupsTest-Group-1999149924: created successfully Sep 04 06:00:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c476a61f-5a5f-4e4b-9b44-723314c0647b tempest-GroupsTest-1103203460 None] Create group completed successfully. Sep 04 06:00:19 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad0947b-c725-49b4-a044-3b9eb70fc903]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:19 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 06:00:19 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:19 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.599s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:19 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db Sep 04 06:00:19 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:20 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db" returned: 0 in 0.774s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:20 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db Sep 04 06:00:20 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:20 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.64592ef6-6fc6-4751-a28d-33e6b037a1db" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-64592ef6-6fc6-4751-a28d-33e6b037a1db" released by "_delete_snapshot" :: held 2.429s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" released by "delete_snapshot" :: held 2.489s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Flow 'volume_create_manager' (25967882-becc-4aaa-a00c-48f130f893a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9edad9-d45f-4d6d-8f62-5f0e07340480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9edad9-d45f-4d6d-8f62-5f0e07340480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1086395337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5160f883-9bb0-4827-997d-a33d23f556fe,host='devstack@QuobyteHD#QuobyteHD',id=332bb74b-6078-4325-bfe5-f5aecc018fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17256e03094b423c8240ec42b99dd44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:21Z,use_quota=True,user_id='f77cb41dcbec4bf89888a4fb16f77f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fe66f05-2dd0-4ee3-9f6b-0aa6470c4c76),volume_type_id=4fe66f05-2dd0-4ee3-9f6b-0aa6470c4c76)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1205a33-7517-45f1-b5d9-ed9b68cbde47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1205a33-7517-45f1-b5d9-ed9b68cbde47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526a94d6-0949-4242-8ea7-1e3a6d9879b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526a94d6-0949-4242-8ea7-1e3a6d9879b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '332bb74b-6078-4325-bfe5-f5aecc018fe5', 'volume_name': 'volume-332bb74b-6078-4325-bfe5-f5aecc018fe5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8792d6a5-d68d-44b1-9fae-2dff5acc78fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8792d6a5-d68d-44b1-9fae-2dff5acc78fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f58bda-775b-4899-8742-24b3eba18c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Volume 332bb74b-6078-4325-bfe5-f5aecc018fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-332bb74b-6078-4325-bfe5-f5aecc018fe5', 'volume_size': 1} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5160f883-9bb0-4827-997d-a33d23f556fe,created_at=2026-09-04T04:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1086395337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5160f883-9bb0-4827-997d-a33d23f556fe,host='devstack@QuobyteHD#QuobyteHD',id=332bb74b-6078-4325-bfe5-f5aecc018fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17256e03094b423c8240ec42b99dd44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:21Z,use_quota=True,user_id='f77cb41dcbec4bf89888a4fb16f77f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fe66f05-2dd0-4ee3-9f6b-0aa6470c4c76),volume_type_id=4fe66f05-2dd0-4ee3-9f6b-0aa6470c4c76)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Creating volume 332bb74b-6078-4325-bfe5-f5aecc018fe5 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:00:21 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-332bb74b-6078-4325-bfe5-f5aecc018fe5 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:21 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-332bb74b-6078-4325-bfe5-f5aecc018fe5 1073741824 Sep 04 06:00:21 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Created reservations ['2431bbb6-b881-4a9f-8814-f799eff70d43', 'ecfe9975-88f6-41d4-a614-19ed0fbca698', '2f0014b4-9c4f-4a75-b5f9-9d959228d592', '2ac38023-34e0-4303-b3fc-9fc771c7d044'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Delete snapshot completed successfully. Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f51dced7-fb63-42c7-9e29-a4beafeaa4d7 tempest-SnapshotsActionsTest-1901217443 None] Lock "cinder-64592ef6-6fc6-4751-a28d-33e6b037a1db-delete_snapshot" released by "delete_snapshot" :: held 2.847s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:21 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-332bb74b-6078-4325-bfe5-f5aecc018fe5 1073741824" returned: 0 in 0.691s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-332bb74b-6078-4325-bfe5-f5aecc018fe5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:21 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-332bb74b-6078-4325-bfe5-f5aecc018fe5 Sep 04 06:00:21 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:22 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-332bb74b-6078-4325-bfe5-f5aecc018fe5" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f58bda-775b-4899-8742-24b3eba18c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332bb74b-6078-4325-bfe5-f5aecc018fe5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96412cae-53c5-413c-bd42-0a0c8fe6b198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Volume volume-332bb74b-6078-4325-bfe5-f5aecc018fe5 (332bb74b-6078-4325-bfe5-f5aecc018fe5): created successfully Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96412cae-53c5-413c-bd42-0a0c8fe6b198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Flow 'volume_create_manager' (25967882-becc-4aaa-a00c-48f130f893a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:00:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a4b6075e-84b9-4fe1-b7a0-a540be4d4ba5 tempest-GroupsTest-1103203460 None] Created volume successfully. Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "cinder-b45b2045-4418-4ad6-b626-55945a6a6886-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Lock "cinder-b45b2045-4418-4ad6-b626-55945a6a6886-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "cinder-quobyte-b45b2045-4418-4ad6-b626-55945a6a6886" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Lock "cinder-quobyte-b45b2045-4418-4ad6-b626-55945a6a6886" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Deleting offline snapshot b45b2045-4418-4ad6-b626-55945a6a6886 of volume 034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] snapshot_file for this snap is: volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[656dbc9a-e7ec-4743-8350-5ae477d7914b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:22 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 06:00:22 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:23 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.483s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034a841b-d84d-4c43-9742-b44c7f7cc148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e4145e-e7c9-4261-8956-f13a0bc2f932]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:23 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 Sep 04 06:00:23 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:23 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148" returned: 0 in 0.661s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:23 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 06:00:23 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:24 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.768s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:24 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886 Sep 04 06:00:24 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Flow 'volume_create_manager' (08ae24ca-5baa-407c-ac2d-65c33c223aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7eda3b-24e7-4fce-ad3f-06b88688e16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7eda3b-24e7-4fce-ad3f-06b88688e16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-18295273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5160f883-9bb0-4827-997d-a33d23f556fe,host='devstack@QuobyteHD#QuobyteHD',id=138ee8fc-ca0d-45f8-8701-3163b41ab098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17256e03094b423c8240ec42b99dd44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:24Z,use_quota=True,user_id='f77cb41dcbec4bf89888a4fb16f77f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fe66f05-2dd0-4ee3-9f6b-0aa6470c4c76),volume_type_id=4fe66f05-2dd0-4ee3-9f6b-0aa6470c4c76)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9829539e-9795-484c-996b-7c7dd0e92dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9829539e-9795-484c-996b-7c7dd0e92dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9562e3ea-5644-414f-8321-cead4a239400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9562e3ea-5644-414f-8321-cead4a239400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '138ee8fc-ca0d-45f8-8701-3163b41ab098', 'volume_name': 'volume-138ee8fc-ca0d-45f8-8701-3163b41ab098', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe65acd-bd17-4c7a-aa23-642b56756caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe65acd-bd17-4c7a-aa23-642b56756caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50ac7ea-ff5b-41fa-876d-f4675459407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Volume 138ee8fc-ca0d-45f8-8701-3163b41ab098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-138ee8fc-ca0d-45f8-8701-3163b41ab098', 'volume_size': 1} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5160f883-9bb0-4827-997d-a33d23f556fe,created_at=2026-09-04T04:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-18295273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5160f883-9bb0-4827-997d-a33d23f556fe,host='devstack@QuobyteHD#QuobyteHD',id=138ee8fc-ca0d-45f8-8701-3163b41ab098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17256e03094b423c8240ec42b99dd44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:24Z,use_quota=True,user_id='f77cb41dcbec4bf89888a4fb16f77f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fe66f05-2dd0-4ee3-9f6b-0aa6470c4c76),volume_type_id=4fe66f05-2dd0-4ee3-9f6b-0aa6470c4c76)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Creating volume 138ee8fc-ca0d-45f8-8701-3163b41ab098 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:00:24 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:00:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-138ee8fc-ca0d-45f8-8701-3163b41ab098 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:24 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-138ee8fc-ca0d-45f8-8701-3163b41ab098 1073741824 Sep 04 06:00:24 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:25 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148.b45b2045-4418-4ad6-b626-55945a6a6886" returned: 0 in 0.528s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Lock "cinder-quobyte-b45b2045-4418-4ad6-b626-55945a6a6886" released by "_delete_snapshot" :: held 2.623s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" released by "delete_snapshot" :: held 2.668s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Created reservations ['9f75da03-4617-4ef6-9c66-d984755de4e8', '9cc667af-2679-44f1-ad10-87e34db9ace9', '8432e0bc-08d1-4353-8f6e-2b636ec06788', '22e5a48f-b8c9-4407-ac60-34b937b49d11'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:25 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:00:25 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Delete snapshot completed successfully. Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-921519eb-943c-4be6-919a-0bbdfb11a8a4 tempest-SnapshotsActionsTest-1091175002 None] Lock "cinder-b45b2045-4418-4ad6-b626-55945a6a6886-delete_snapshot" released by "delete_snapshot" :: held 2.910s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:25 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-138ee8fc-ca0d-45f8-8701-3163b41ab098 1073741824" returned: 0 in 0.622s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-138ee8fc-ca0d-45f8-8701-3163b41ab098 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:25 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-138ee8fc-ca0d-45f8-8701-3163b41ab098 Sep 04 06:00:25 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:25 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:00:25 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-138ee8fc-ca0d-45f8-8701-3163b41ab098" returned: 0 in 0.329s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50ac7ea-ff5b-41fa-876d-f4675459407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138ee8fc-ca0d-45f8-8701-3163b41ab098', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbd7145-4d12-4e62-b388-4be6556dd61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "cinder-034a841b-d84d-4c43-9742-b44c7f7cc148-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Volume volume-138ee8fc-ca0d-45f8-8701-3163b41ab098 (138ee8fc-ca0d-45f8-8701-3163b41ab098): created successfully Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbd7145-4d12-4e62-b388-4be6556dd61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Flow 'volume_create_manager' (08ae24ca-5baa-407c-ac2d-65c33c223aa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:00:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Lock "cinder-034a841b-d84d-4c43-9742-b44c7f7cc148-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c5e39e9b-afcc-4642-8a31-6e047e4ce32c tempest-GroupsTest-1103203460 None] Created volume successfully. Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[43442e04-0ba5-498c-a919-4275389e2e0a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:26 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 Sep 04 06:00:26 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:26 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:26 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148 Sep 04 06:00:26 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:26 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-034a841b-d84d-4c43-9742-b44c7f7cc148" returned: 0 in 0.240s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Lock "cinder-quobyte-034a841b-d84d-4c43-9742-b44c7f7cc148" released by "delete_volume" :: held 0.663s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Created reservations ['2e71274b-1357-4769-bc2a-e6f4dd4a0c1e', 'f2ac6d6f-8b9c-4fff-9e69-8661bd093380', '9f285aff-a6e0-4940-8b78-508694da1c72', '1c800bb0-5531-4d6e-bdee-38264e665e68'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:26 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:00:26 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:27 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:27 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:00:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Deleted volume successfully. Sep 04 06:00:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-77d329d9-10e2-4a1a-85e8-6e80dcfdbdae tempest-SnapshotsActionsTest-1091175002 None] Lock "cinder-034a841b-d84d-4c43-9742-b44c7f7cc148-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-07b39aa0-4c01-4d61-99dd-96f1c248b4f7 tempest-GroupsTest-1103203460 None] Update group completed successfully. Sep 04 06:00:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-844a337e-a764-4fd8-85d4-efa7834c1efb tempest-GroupsTest-1103203460 None] Update group completed successfully. Sep 04 06:00:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Acquiring lock "cinder-quobyte-138ee8fc-ca0d-45f8-8701-3163b41ab098" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Lock "cinder-quobyte-138ee8fc-ca0d-45f8-8701-3163b41ab098" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42713eb-20a6-44a9-9713-a793ed1206d9]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-138ee8fc-ca0d-45f8-8701-3163b41ab098 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:30 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-138ee8fc-ca0d-45f8-8701-3163b41ab098 Sep 04 06:00:30 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:31 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-138ee8fc-ca0d-45f8-8701-3163b41ab098" returned: 0 in 0.424s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-138ee8fc-ca0d-45f8-8701-3163b41ab098 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:31 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-138ee8fc-ca0d-45f8-8701-3163b41ab098 Sep 04 06:00:31 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:31 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-138ee8fc-ca0d-45f8-8701-3163b41ab098" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Lock "cinder-quobyte-138ee8fc-ca0d-45f8-8701-3163b41ab098" released by "delete_volume" :: held 0.770s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Acquiring lock "cinder-quobyte-332bb74b-6078-4325-bfe5-f5aecc018fe5" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Lock "cinder-quobyte-332bb74b-6078-4325-bfe5-f5aecc018fe5" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dcac1d-ba6f-4a4d-bcbe-540cf2fc7421]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-332bb74b-6078-4325-bfe5-f5aecc018fe5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:31 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-332bb74b-6078-4325-bfe5-f5aecc018fe5 Sep 04 06:00:31 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:31 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-332bb74b-6078-4325-bfe5-f5aecc018fe5" returned: 0 in 0.424s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-332bb74b-6078-4325-bfe5-f5aecc018fe5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:31 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-332bb74b-6078-4325-bfe5-f5aecc018fe5 Sep 04 06:00:31 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:32 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-332bb74b-6078-4325-bfe5-f5aecc018fe5" returned: 0 in 0.344s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Lock "cinder-quobyte-332bb74b-6078-4325-bfe5-f5aecc018fe5" released by "delete_volume" :: held 0.816s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Created reservations ['193da355-c2a9-4d12-90b7-e6893d636a8e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:32 devstack cinder-volume[87132]: WARNING cinder.quota [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-7393966 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-7393966, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:00:32 devstack cinder-volume[87132]: WARNING cinder.quota [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-7393966 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-7393966, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:00:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Created reservations ['733f08b1-4be3-418c-a426-75366302b487', '0b89a00a-a53e-4258-8555-6589c4575906', 'b8120483-43c1-4833-a406-7b327de311cc', 'd18be2d5-a6d7-46ae-8734-0a924188efba'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Created reservations ['8cd2aab4-6044-46ac-87ff-a6122fd554ac', '235b8f2f-af9f-4f2e-9c04-903d18e93180', 'df24c6b0-a0c4-4f3a-92ca-8438022fa5e7', '846de793-f3b6-4303-9c60-4d8478d23cbe'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:32 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:00:32 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:33 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.313s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:33 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:00:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-391b9334-df3a-465d-bb5e-11e72740481f tempest-GroupsTest-1103203460 None] Delete group completed successfully. Sep 04 06:00:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-59b13b9c-952f-4fc8-a986-dfb9d57171e7 tempest-GroupsV314Test-53342918 None] Group tempest-GroupsV314Test-Group-593181181: creating Sep 04 06:00:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-59b13b9c-952f-4fc8-a986-dfb9d57171e7 tempest-GroupsV314Test-53342918 None] Group tempest-GroupsV314Test-Group-593181181: created successfully Sep 04 06:00:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-59b13b9c-952f-4fc8-a986-dfb9d57171e7 tempest-GroupsV314Test-53342918 None] Create group completed successfully. Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Flow 'volume_create_manager' (be4e43b7-a6ec-4370-9305-fb85169a7217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40947281-b3fa-4020-a593-6c32a86adfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40947281-b3fa-4020-a593-6c32a86adfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1467423695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=207b2434-43aa-4af8-a009-643a08cc2f31,host='devstack@QuobyteHD#QuobyteHD',id=6d092d3b-76c2-46a8-9cb5-600aeccaccad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4638503431bf44b299b75140f64612d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:41Z,use_quota=True,user_id='7c8affe6044445f0820918da06d9d646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c373e618-ed90-4d54-8ee3-38468e1824e6),volume_type_id=c373e618-ed90-4d54-8ee3-38468e1824e6)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7802a81e-1d19-4a4a-a99f-4a7b8fceb10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7802a81e-1d19-4a4a-a99f-4a7b8fceb10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94a098c-7d33-4228-a681-f1a2b6ee6cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94a098c-7d33-4228-a681-f1a2b6ee6cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d092d3b-76c2-46a8-9cb5-600aeccaccad', 'volume_name': 'volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c295b468-abb4-46a7-835d-c736eb6ce065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c295b468-abb4-46a7-835d-c736eb6ce065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9b0ae5-3fd5-47d2-a365-cb9f8cda99f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Volume 6d092d3b-76c2-46a8-9cb5-600aeccaccad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad', 'volume_size': 1} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=207b2434-43aa-4af8-a009-643a08cc2f31,created_at=2026-09-04T04:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1467423695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=207b2434-43aa-4af8-a009-643a08cc2f31,host='devstack@QuobyteHD#QuobyteHD',id=6d092d3b-76c2-46a8-9cb5-600aeccaccad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4638503431bf44b299b75140f64612d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:41Z,use_quota=True,user_id='7c8affe6044445f0820918da06d9d646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c373e618-ed90-4d54-8ee3-38468e1824e6),volume_type_id=c373e618-ed90-4d54-8ee3-38468e1824e6)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Creating volume 6d092d3b-76c2-46a8-9cb5-600aeccaccad {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:00:41 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:00:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:41 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad 1073741824 Sep 04 06:00:41 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:42 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad 1073741824" returned: 0 in 0.561s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:42 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad Sep 04 06:00:42 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:42 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:00:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9b0ae5-3fd5-47d2-a365-cb9f8cda99f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c8aaab-81d3-4efd-b9da-65941b7bf412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Volume volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad (6d092d3b-76c2-46a8-9cb5-600aeccaccad): created successfully Sep 04 06:00:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c8aaab-81d3-4efd-b9da-65941b7bf412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Flow 'volume_create_manager' (be4e43b7-a6ec-4370-9305-fb85169a7217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:00:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-247ac9ee-841b-4849-9a07-9008e119067c tempest-GroupsV314Test-53342918 None] Created volume successfully. Sep 04 06:00:44 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=123,cinder:SELECT=118,cinder:DELETE=6,cinder:INSERT=26 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:00:44 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=139,cinder:UPDATE=127,cinder:INSERT=32,cinder:DELETE=7 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:00:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:44 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Cloning volume 6d092d3b-76c2-46a8-9cb5-600aeccaccad to volume c13512a2-60a5-480c-8d2c-c953d74a9064 Sep 04 06:00:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Creating offline snapshot a8690812-7502-473d-8bb2-d395ef8135dc of volume 6d092d3b-76c2-46a8-9cb5-600aeccaccad {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:00:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[12212a3d-37c3-4379-938f-e148feb4a36f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:44 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad Sep 04 06:00:44 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:44 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad" returned: 0 in 0.450s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:44 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc 1G Sep 04 06:00:44 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:45 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc 1G" returned: 0 in 0.473s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:45 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc Sep 04 06:00:45 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:45 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc" returned: 0 in 0.639s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:45 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc is being set with open permissions: ugo+rw: NotImplementedError Sep 04 06:00:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:46 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc Sep 04 06:00:46 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:46 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc" returned: 0 in 0.413s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:46 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.info Sep 04 06:00:46 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:46 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.info" returned: 0 in 0.375s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:46 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 06:00:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:46 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:00:46 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.info Sep 04 06:00:46 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Flow 'volume_create_manager' (18d7411a-8dfa-446a-bfd1-c047bc3396b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:00:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019f0b32-4196-4802-95da-e98dd576f55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019f0b32-4196-4802-95da-e98dd576f55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-572076160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d375a4-4513-4249-9d5d-c92574c7e9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83620fd2fa54f68845ec64ef2c9ad09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:47Z,use_quota=True,user_id='b880f650161743908af4808f06bafc75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bed4a211-9c28-412d-816e-495f8986d4c2),volume_type_id=bed4a211-9c28-412d-816e-495f8986d4c2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b5c4a2-6cda-4be4-9625-14066a8908bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b5c4a2-6cda-4be4-9625-14066a8908bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50eaac53-ae04-40b6-a9aa-3adb02f89d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50eaac53-ae04-40b6-a9aa-3adb02f89d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d375a4-4513-4249-9d5d-c92574c7e9f8', 'volume_name': 'volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948d439a-f9bb-4db3-b7b5-e8576e1214a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948d439a-f9bb-4db3-b7b5-e8576e1214a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5f37f8-5a4a-4341-a423-5ecf9e02425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Volume c2d375a4-4513-4249-9d5d-c92574c7e9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8', 'volume_size': 1} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:47 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.info" returned: 0 in 0.331s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Acquiring lock "cinder-quobyte-c13512a2-60a5-480c-8d2c-c953d74a9064" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Lock "cinder-quobyte-c13512a2-60a5-480c-8d2c-c953d74a9064" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] snapshot: a8690812-7502-473d-8bb2-d395ef8135dc, volume: c13512a2-60a5-480c-8d2c-c953d74a9064, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[857c43e0-344f-4f6a-a768-ca8b692eb901]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:47 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc Sep 04 06:00:47 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:47 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc" returned: 0 in 0.459s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaba020-a48f-410c-a0cf-221a6dd9ce4f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:47 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad Sep 04 06:00:47 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:48 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad" returned: 0 in 0.406s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] will copy from snapshot at /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 06:00:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 06:00:48 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Path /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 06:00:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:48 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064 Sep 04 06:00:48 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-081d8af9-26b0-4155-a5ef-2e8ff757c27c req-37fae50c-7969-4bb1-8da5-2f62da3cf857 tempest-AttachVolumeNegativeTest-1175679777 None] Terminate volume connection completed successfully. Sep 04 06:00:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-081d8af9-26b0-4155-a5ef-2e8ff757c27c req-37fae50c-7969-4bb1-8da5-2f62da3cf857 tempest-AttachVolumeNegativeTest-1175679777 None] Deleting attachment c9bc6e73-4511-464c-97b5-1ad15ce2cdc2. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:00:53 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064" returned: 0 in 4.975s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:53 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:00:53 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Converted 1024.00 MB image at 205.78 MB/s Sep 04 06:00:53 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 06:00:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:53 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064 Sep 04 06:00:53 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:53 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064" returned: 0 in 0.289s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Lock "cinder-quobyte-c13512a2-60a5-480c-8d2c-c953d74a9064" released by "_copy_volume_from_snapshot" :: held 6.223s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Acquiring lock "cinder-quobyte-a8690812-7502-473d-8bb2-d395ef8135dc" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Lock "cinder-quobyte-a8690812-7502-473d-8bb2-d395ef8135dc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Deleting offline snapshot a8690812-7502-473d-8bb2-d395ef8135dc of volume 6d092d3b-76c2-46a8-9cb5-600aeccaccad {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:00:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] snapshot_file for this snap is: volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:00:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29901dc-6061-499f-8c6e-e2b12b8c401a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:53 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc Sep 04 06:00:53 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:54 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc" returned: 0 in 0.545s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:00:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d952628-898e-4b1e-bc09-03d59d2c835c]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:54 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad Sep 04 06:00:54 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:54 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad" returned: 0 in 0.603s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:54 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc Sep 04 06:00:54 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:55 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc" returned: 0 in 0.427s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:55 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc Sep 04 06:00:55 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:55 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad.a8690812-7502-473d-8bb2-d395ef8135dc" returned: 0 in 0.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Lock "cinder-quobyte-a8690812-7502-473d-8bb2-d395ef8135dc" released by "_delete_snapshot" :: held 2.037s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.238s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.566s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-572076160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d375a4-4513-4249-9d5d-c92574c7e9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83620fd2fa54f68845ec64ef2c9ad09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:47Z,use_quota=True,user_id='b880f650161743908af4808f06bafc75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bed4a211-9c28-412d-816e-495f8986d4c2),volume_type_id=bed4a211-9c28-412d-816e-495f8986d4c2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Creating volume c2d375a4-4513-4249-9d5d-c92574c7e9f8 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:00:55 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:00:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:55 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8 1073741824 Sep 04 06:00:55 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7faa1981-bd0a-4a27-9388-87d476f03e96 tempest-GroupsV314Test-53342918 None] Create group from source-group-207b2434-43aa-4af8-a009-643a08cc2f31 completed successfully. Sep 04 06:00:56 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8 1073741824" returned: 0 in 0.461s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:56 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8 Sep 04 06:00:56 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:56 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8" returned: 0 in 0.349s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5f37f8-5a4a-4341-a423-5ecf9e02425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fb7bc0-466d-4670-a025-be11667d3d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:00:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Volume volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8 (c2d375a4-4513-4249-9d5d-c92574c7e9f8): created successfully Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fb7bc0-466d-4670-a025-be11667d3d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Flow 'volume_create_manager' (18d7411a-8dfa-446a-bfd1-c047bc3396b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:00:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f8f14346-68dd-4f36-af44-328aee4f43ea tempest-VolumeTypesAccessTest-1587572977 None] Created volume successfully. Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Acquiring lock "cinder-quobyte-c13512a2-60a5-480c-8d2c-c953d74a9064" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Acquiring lock "cinder-c2d375a4-4513-4249-9d5d-c92574c7e9f8-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Lock "cinder-quobyte-c13512a2-60a5-480c-8d2c-c953d74a9064" acquired by "delete_volume" :: waited 0.048s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Lock "cinder-c2d375a4-4513-4249-9d5d-c92574c7e9f8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff10df4-79cb-45b8-9c2c-843ba5db868b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Acquiring lock "cinder-quobyte-c2d375a4-4513-4249-9d5d-c92574c7e9f8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Lock "cinder-quobyte-c2d375a4-4513-4249-9d5d-c92574c7e9f8" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f332d67-7934-4189-a6db-1b677a862815]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:57 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064 Sep 04 06:00:57 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:57 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8 Sep 04 06:00:57 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:57 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064" returned: 0 in 0.430s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:57 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064 Sep 04 06:00:57 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:57 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8" returned: 0 in 0.436s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:57 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8 Sep 04 06:00:57 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:57 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c13512a2-60a5-480c-8d2c-c953d74a9064" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Lock "cinder-quobyte-c13512a2-60a5-480c-8d2c-c953d74a9064" released by "delete_volume" :: held 0.796s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Created reservations ['c627e919-d13e-4774-b5e8-7634a5592cf5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:57 devstack cinder-volume[87132]: WARNING cinder.quota [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-234304097 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-234304097, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:00:57 devstack cinder-volume[87132]: WARNING cinder.quota [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-234304097 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-234304097, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:00:57 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d375a4-4513-4249-9d5d-c92574c7e9f8" returned: 0 in 0.297s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Lock "cinder-quobyte-c2d375a4-4513-4249-9d5d-c92574c7e9f8" released by "delete_volume" :: held 0.794s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Created reservations ['a958feca-820c-4319-8e26-80289dcaf71f', '712a4f90-ac05-429b-a7a3-beae587a4d71', 'b26ec23a-6db6-4e03-8069-1d2b14c2358d', '3989c42a-9df3-42de-bdcc-013c15874b60'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:57 devstack cinder-volume[87132]: WARNING cinder.quota [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-431104191 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-431104191, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:00:57 devstack cinder-volume[87132]: WARNING cinder.quota [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-431104191 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-431104191, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Created reservations ['3997853b-7c85-4c61-94de-e2127ab9deac', '0c92288f-d150-41ed-9544-18e7d41ffdc4', 'fc9b7801-bd83-471f-acf5-6d5589407dde', '0db88caa-5132-472e-bf09-de42f1c7164c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:57 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:00:57 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:58 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:00:58 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:58 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:58 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:00:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Deleted volume successfully. Sep 04 06:00:58 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.540s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:58 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:00:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93e8ef3f-5f4d-4bf3-a631-e4fab8e2f583 tempest-VolumeTypesAccessTest-1587572977 None] Lock "cinder-c2d375a4-4513-4249-9d5d-c92574c7e9f8-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3fc76108-4553-452c-b955-ec1ed4b17277 tempest-GroupsV314Test-53342918 None] Delete group completed successfully. Sep 04 06:00:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Acquiring lock "cinder-quobyte-6d092d3b-76c2-46a8-9cb5-600aeccaccad" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:00:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Lock "cinder-quobyte-6d092d3b-76c2-46a8-9cb5-600aeccaccad" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:00:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d39f3d-9a8d-4d63-82e2-8726b5c7bf29]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:00:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:58 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad Sep 04 06:00:58 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:59 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad" returned: 0 in 0.435s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:59 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad Sep 04 06:00:59 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:00:59 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Sep 04 06:00:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d092d3b-76c2-46a8-9cb5-600aeccaccad" returned: 0 in 0.304s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:00:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Lock "cinder-quobyte-6d092d3b-76c2-46a8-9cb5-600aeccaccad" released by "delete_volume" :: held 0.840s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:00:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Created reservations ['1d4c42ca-bea3-49b4-9fff-1189923fed48'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Created reservations ['2648789c-2880-42c6-828a-7fde99110582', '7ebec5f5-e945-4084-8206-7b30a1c4a4a5', '2c7d388c-b0e4-4a44-80df-cd6436927fb0', '9b339f38-251d-45af-961f-d1b2fcb37f58'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:00:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:00:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:00:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:00:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:00:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:00:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:00:59 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:00:59 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:00 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:01:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-22504ee6-5ee1-4e06-8100-f91ff5e0dec1 tempest-GroupsV314Test-53342918 None] Delete group completed successfully. Sep 04 06:01:09 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=30,cinder:INSERT=7,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:01:09 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=31,cinder:INSERT=10,cinder:UPDATE=37,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:01:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:01:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:01:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:01:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:25 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:01:25 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:25 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.304s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:01:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:01:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:01:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Flow 'volume_create_manager' (03252d65-977d-4556-8968-984ce9ab7abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddb4f15-89dc-42cf-9af3-5d1c9574c2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddb4f15-89dc-42cf-9af3-5d1c9574c2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1997569990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1193d9f8-d653-41e0-a47a-8269cc4b6e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d06b0a8d0b4e8a9bbb432b2fbe086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:31Z,use_quota=True,user_id='ecf22ca64c0f4ebdb749d57d11d01a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be87fbe5-b8ad-48a3-8aae-d8e018bf3cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be87fbe5-b8ad-48a3-8aae-d8e018bf3cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15fe6bb-9b42-46c8-b9e0-410cbea04171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15fe6bb-9b42-46c8-b9e0-410cbea04171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1193d9f8-d653-41e0-a47a-8269cc4b6e78', 'volume_name': 'volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e65f55-db08-43dc-bcab-6e9e44409e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e65f55-db08-43dc-bcab-6e9e44409e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4fe67c-1337-416b-8cd5-1cb7a00561bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Volume 1193d9f8-d653-41e0-a47a-8269cc4b6e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78', 'volume_size': 1} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1997569990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1193d9f8-d653-41e0-a47a-8269cc4b6e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d06b0a8d0b4e8a9bbb432b2fbe086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:31Z,use_quota=True,user_id='ecf22ca64c0f4ebdb749d57d11d01a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Creating volume 1193d9f8-d653-41e0-a47a-8269cc4b6e78 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:01:31 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:01:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:31 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78 1073741824 Sep 04 06:01:31 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:32 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78 1073741824" returned: 0 in 0.789s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:32 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78 Sep 04 06:01:32 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-99e346b7-1ed0-48d8-b7b4-76c21abb215a req-32775b2c-639e-4116-9fdc-18e10663dc60 tempest-AttachVolumeTestJSON-1586140776 None] Terminate volume connection completed successfully. Sep 04 06:01:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-99e346b7-1ed0-48d8-b7b4-76c21abb215a req-32775b2c-639e-4116-9fdc-18e10663dc60 tempest-AttachVolumeTestJSON-1586140776 None] Deleting attachment daba6255-1f2a-4ec8-8184-6fe6e065c971. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:01:32 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:01:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4fe67c-1337-416b-8cd5-1cb7a00561bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcada9d9-ee33-471e-a2ee-ba6a532c33f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Volume volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78 (1193d9f8-d653-41e0-a47a-8269cc4b6e78): created successfully Sep 04 06:01:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcada9d9-ee33-471e-a2ee-ba6a532c33f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Flow 'volume_create_manager' (03252d65-977d-4556-8968-984ce9ab7abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:01:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b4042a9b-7bd8-404d-ab25-fe7961553e63 tempest-AttachVolumeNegativeTest-1175679777 None] Created volume successfully. Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Flow 'volume_create_manager' (07067e3b-09de-4853-8c1b-303913c460d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0269fc8d-d142-4081-b1b2-4423addec900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0269fc8d-d142-4081-b1b2-4423addec900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1663810617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac2de05-216b-48b9-8e6c-cdb4e99857c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecb1e3677674415a21c6cc89dce2798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:34Z,use_quota=True,user_id='e6f6ac9aef1247bb9d1a79c3daa65ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac7f2d5-d0f8-41ea-a5fc-9a92ec425f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac7f2d5-d0f8-41ea-a5fc-9a92ec425f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0455bbb9-e8fa-4224-8b6f-53a52fd92661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0455bbb9-e8fa-4224-8b6f-53a52fd92661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac2de05-216b-48b9-8e6c-cdb4e99857c8', 'volume_name': 'volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb01b69-4f26-4234-9a45-e6839093fe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb01b69-4f26-4234-9a45-e6839093fe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b43257-d0b2-4e7e-9070-37897a152d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Volume 4ac2de05-216b-48b9-8e6c-cdb4e99857c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8', 'volume_size': 1} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1663810617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac2de05-216b-48b9-8e6c-cdb4e99857c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecb1e3677674415a21c6cc89dce2798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:34Z,use_quota=True,user_id='e6f6ac9aef1247bb9d1a79c3daa65ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Creating volume 4ac2de05-216b-48b9-8e6c-cdb4e99857c8 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:01:34 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:34 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8 1073741824 Sep 04 06:01:34 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-526e66af-e656-4510-88f9-b179bc5d9cc9 req-371c58fc-5daa-4689-9269-ab3f7f3f2e43 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:34 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8 1073741824" returned: 0 in 0.605s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:34 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8 Sep 04 06:01:34 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:35 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8" returned: 0 in 0.330s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:01:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-526e66af-e656-4510-88f9-b179bc5d9cc9 req-371c58fc-5daa-4689-9269-ab3f7f3f2e43 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.622s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b43257-d0b2-4e7e-9070-37897a152d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73215a4d-9b55-4770-852b-4c90f9459e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-526e66af-e656-4510-88f9-b179bc5d9cc9 req-371c58fc-5daa-4689-9269-ab3f7f3f2e43 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Volume volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8 (4ac2de05-216b-48b9-8e6c-cdb4e99857c8): created successfully Sep 04 06:01:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73215a4d-9b55-4770-852b-4c90f9459e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Flow 'volume_create_manager' (07067e3b-09de-4853-8c1b-303913c460d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:01:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7c02a03a-0e5e-48df-9a70-eeae75491b19 tempest-VolumeQuotasAdminTestJSON-870049576 None] Created volume successfully. Sep 04 06:01:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-526e66af-e656-4510-88f9-b179bc5d9cc9 req-371c58fc-5daa-4689-9269-ab3f7f3f2e43 tempest-AttachVolumeNegativeTest-1175679777 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3226ff00-4284-407f-82bb-29f5690b9692', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:01:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-526e66af-e656-4510-88f9-b179bc5d9cc9 req-371c58fc-5daa-4689-9269-ab3f7f3f2e43 tempest-AttachVolumeNegativeTest-1175679777 None] attachment_update completed successfully. Sep 04 06:01:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Acquiring lock "cinder-4ac2de05-216b-48b9-8e6c-cdb4e99857c8-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:01:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "cinder-4ac2de05-216b-48b9-8e6c-cdb4e99857c8-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:01:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Acquiring lock "cinder-quobyte-4ac2de05-216b-48b9-8e6c-cdb4e99857c8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:01:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "cinder-quobyte-4ac2de05-216b-48b9-8e6c-cdb4e99857c8" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:01:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10b77ef-2500-4c8f-b2db-23ed1f2cca15]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:01:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:36 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8 Sep 04 06:01:36 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:37 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8" returned: 0 in 0.607s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:37 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8 Sep 04 06:01:37 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:37 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4ac2de05-216b-48b9-8e6c-cdb4e99857c8" returned: 0 in 0.319s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "cinder-quobyte-4ac2de05-216b-48b9-8e6c-cdb4e99857c8" released by "delete_volume" :: held 1.035s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:01:37 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Created reservations ['d5b4ce09-9d65-4538-915a-0a10d3b2906a', '3f720e6e-4af4-4e16-8af6-06171d60687d', '25553291-7836-455c-9839-0d1ac61997fb', '87c6d8db-a1fe-43d2-97da-57eb02f0b5c3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:01:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:01:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:01:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:38 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:01:38 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:38 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:38 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:01:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Deleted volume successfully. Sep 04 06:01:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7fbd4cca-4b35-4031-aae6-dd849bc31661 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "cinder-4ac2de05-216b-48b9-8e6c-cdb4e99857c8-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:01:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-5fd66551-ec48-489e-91a6-669066bb6696 req-713173e1-ff1b-4fc0-998e-996a8042371d tempest-AttachVolumeNegativeTest-1175679777 None] Terminate volume connection completed successfully. Sep 04 06:01:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-5fd66551-ec48-489e-91a6-669066bb6696 req-713173e1-ff1b-4fc0-998e-996a8042371d tempest-AttachVolumeNegativeTest-1175679777 None] Deleting attachment 3226ff00-4284-407f-82bb-29f5690b9692. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Flow 'volume_create_manager' (ee13c850-187a-43d7-81a9-8396a0106b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb69e9f-4748-4472-9390-c0d284edf88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb69e9f-4748-4472-9390-c0d284edf88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-151085913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09497ae8-4e27-4eea-8693-6d7aa17ca9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7ebeca75545099b301fc46088b1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:40Z,use_quota=True,user_id='d642c5e2b88945fa8c50ddc340ce3f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d762d034-b59e-4113-96f0-8b13ac3bb6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d762d034-b59e-4113-96f0-8b13ac3bb6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132228fb-4901-4828-b826-e5cbf7a02555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132228fb-4901-4828-b826-e5cbf7a02555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09497ae8-4e27-4eea-8693-6d7aa17ca9f4', 'volume_name': 'volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8403ab-7dc0-497b-a004-07ae7fcef941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8403ab-7dc0-497b-a004-07ae7fcef941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdeb8190-9aa6-47b4-adb7-d0378227e3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Volume 09497ae8-4e27-4eea-8693-6d7aa17ca9f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4', 'volume_size': 1} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-151085913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09497ae8-4e27-4eea-8693-6d7aa17ca9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7ebeca75545099b301fc46088b1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:40Z,use_quota=True,user_id='d642c5e2b88945fa8c50ddc340ce3f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Creating volume 09497ae8-4e27-4eea-8693-6d7aa17ca9f4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:01:40 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:40 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4 1073741824 Sep 04 06:01:40 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Flow 'volume_create_manager' (d3a622ab-ee53-4819-bbf0-11b786ae9298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143cea38-5d80-4e00-8d43-6c2d571786ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143cea38-5d80-4e00-8d43-6c2d571786ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-75519327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39461f45-2be6-47c9-9584-3fe0ea4ea658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecb1e3677674415a21c6cc89dce2798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:40Z,use_quota=True,user_id='e6f6ac9aef1247bb9d1a79c3daa65ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f433bd-8c64-4905-b49f-5d994000972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f433bd-8c64-4905-b49f-5d994000972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb93583-cbd8-46d4-a7ca-f8e9b8c7abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb93583-cbd8-46d4-a7ca-f8e9b8c7abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39461f45-2be6-47c9-9584-3fe0ea4ea658', 'volume_name': 'volume-39461f45-2be6-47c9-9584-3fe0ea4ea658', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06d281d-4536-49de-a13e-c11f2074fa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06d281d-4536-49de-a13e-c11f2074fa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddcc6f93-56a3-4d4a-ab7f-8d96ebfc7cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Volume 39461f45-2be6-47c9-9584-3fe0ea4ea658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39461f45-2be6-47c9-9584-3fe0ea4ea658', 'volume_size': 1} Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:40 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4 1073741824" returned: 0 in 0.725s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:41 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4 Sep 04 06:01:41 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:41 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4" returned: 0 in 0.517s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-75519327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39461f45-2be6-47c9-9584-3fe0ea4ea658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecb1e3677674415a21c6cc89dce2798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:40Z,use_quota=True,user_id='e6f6ac9aef1247bb9d1a79c3daa65ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Creating volume 39461f45-2be6-47c9-9584-3fe0ea4ea658 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:01:41 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-39461f45-2be6-47c9-9584-3fe0ea4ea658 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdeb8190-9aa6-47b4-adb7-d0378227e3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476f935f-8476-4b08-9bad-6e9936b40f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:41 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-39461f45-2be6-47c9-9584-3fe0ea4ea658 1073741824 Sep 04 06:01:41 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Volume volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4 (09497ae8-4e27-4eea-8693-6d7aa17ca9f4): created successfully Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476f935f-8476-4b08-9bad-6e9936b40f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Flow 'volume_create_manager' (ee13c850-187a-43d7-81a9-8396a0106b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:01:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-aa17428b-b8fa-4844-a79e-dd3ee48eb46d tempest-VolumesActionsTest-1736543637 None] Created volume successfully. Sep 04 06:01:42 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-39461f45-2be6-47c9-9584-3fe0ea4ea658 1073741824" returned: 0 in 0.729s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-39461f45-2be6-47c9-9584-3fe0ea4ea658 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:42 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-39461f45-2be6-47c9-9584-3fe0ea4ea658 Sep 04 06:01:42 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b174e66f-ccff-4f30-88c2-02884388710f tempest-VolumesActionsTest-1736543637 None] Acquiring lock "cinder-09497ae8-4e27-4eea-8693-6d7aa17ca9f4" by "attach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:01:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b174e66f-ccff-4f30-88c2-02884388710f tempest-VolumesActionsTest-1736543637 None] Lock "cinder-09497ae8-4e27-4eea-8693-6d7aa17ca9f4" acquired by "attach_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:01:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b174e66f-ccff-4f30-88c2-02884388710f tempest-VolumesActionsTest-1736543637 None] Attaching volume 09497ae8-4e27-4eea-8693-6d7aa17ca9f4 to instance 50eecfa2-518b-47dd-bfca-89487b37956c at mountpoint /dev/vdb on host None. Sep 04 06:01:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b174e66f-ccff-4f30-88c2-02884388710f tempest-VolumesActionsTest-1736543637 None] Attach volume completed successfully. Sep 04 06:01:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b174e66f-ccff-4f30-88c2-02884388710f tempest-VolumesActionsTest-1736543637 None] Lock "cinder-09497ae8-4e27-4eea-8693-6d7aa17ca9f4" released by "attach_volume" :: held 0.262s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:01:42 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-39461f45-2be6-47c9-9584-3fe0ea4ea658" returned: 0 in 0.579s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:01:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddcc6f93-56a3-4d4a-ab7f-8d96ebfc7cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39461f45-2be6-47c9-9584-3fe0ea4ea658', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6120611b-aeb4-43e9-b382-d10128442b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Volume volume-39461f45-2be6-47c9-9584-3fe0ea4ea658 (39461f45-2be6-47c9-9584-3fe0ea4ea658): created successfully Sep 04 06:01:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6120611b-aeb4-43e9-b382-d10128442b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Flow 'volume_create_manager' (d3a622ab-ee53-4819-bbf0-11b786ae9298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:01:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d66f77b2-e1e7-4ab4-b5f4-a9d8bf3fb387 tempest-VolumeQuotasAdminTestJSON-870049576 None] Created volume successfully. Sep 04 06:01:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fbe80a70-4d68-4aed-89da-388595127070 tempest-VolumesActionsTest-1501069181 None] Terminate volume connection completed successfully. Sep 04 06:01:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fbe80a70-4d68-4aed-89da-388595127070 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "cinder-09497ae8-4e27-4eea-8693-6d7aa17ca9f4-detach_volume" by "detach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:01:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fbe80a70-4d68-4aed-89da-388595127070 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-09497ae8-4e27-4eea-8693-6d7aa17ca9f4-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:01:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fbe80a70-4d68-4aed-89da-388595127070 tempest-VolumesActionsTest-1501069181 None] Detaching volume 09497ae8-4e27-4eea-8693-6d7aa17ca9f4 from instance 50eecfa2-518b-47dd-bfca-89487b37956c. Sep 04 06:01:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fbe80a70-4d68-4aed-89da-388595127070 tempest-VolumesActionsTest-1501069181 None] Detach volume completed successfully. Sep 04 06:01:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fbe80a70-4d68-4aed-89da-388595127070 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-09497ae8-4e27-4eea-8693-6d7aa17ca9f4-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:01:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b0b7d8e-c369-45a9-bc40-13c727c759cf tempest-VolumesActionsTest-1736543637 None] Acquiring lock "cinder-09497ae8-4e27-4eea-8693-6d7aa17ca9f4-detach_volume" by "detach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:01:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b0b7d8e-c369-45a9-bc40-13c727c759cf tempest-VolumesActionsTest-1736543637 None] Lock "cinder-09497ae8-4e27-4eea-8693-6d7aa17ca9f4-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:01:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8b0b7d8e-c369-45a9-bc40-13c727c759cf tempest-VolumesActionsTest-1736543637 None] Volume detach called, but volume not attached. Sep 04 06:01:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b0b7d8e-c369-45a9-bc40-13c727c759cf tempest-VolumesActionsTest-1736543637 None] Lock "cinder-09497ae8-4e27-4eea-8693-6d7aa17ca9f4-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:01:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Acquiring lock "cinder-09497ae8-4e27-4eea-8693-6d7aa17ca9f4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:01:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-09d8b428-ae06-4686-b2e1-10f69bc10cb7 tempest-VolumeQuotasAdminTestJSON-1681626063 None] Transfer volume completed successfully. Sep 04 06:01:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Lock "cinder-09497ae8-4e27-4eea-8693-6d7aa17ca9f4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:01:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Acquiring lock "cinder-quobyte-09497ae8-4e27-4eea-8693-6d7aa17ca9f4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:01:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Lock "cinder-quobyte-09497ae8-4e27-4eea-8693-6d7aa17ca9f4" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:01:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2ab234-a20e-4e57-8fb5-a3c46f306cdd]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:01:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:45 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4 Sep 04 06:01:45 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:45 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4" returned: 0 in 0.634s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:45 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4 Sep 04 06:01:45 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Acquiring lock "cinder-39461f45-2be6-47c9-9584-3fe0ea4ea658-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:01:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Lock "cinder-39461f45-2be6-47c9-9584-3fe0ea4ea658-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Acquiring lock "cinder-quobyte-39461f45-2be6-47c9-9584-3fe0ea4ea658" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Lock "cinder-quobyte-39461f45-2be6-47c9-9584-3fe0ea4ea658" acquired by "delete_volume" :: waited 0.051s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be57016-fe98-461b-88f6-7f801093ffaf]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-39461f45-2be6-47c9-9584-3fe0ea4ea658 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:46 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09497ae8-4e27-4eea-8693-6d7aa17ca9f4" returned: 0 in 0.547s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Lock "cinder-quobyte-09497ae8-4e27-4eea-8693-6d7aa17ca9f4" released by "delete_volume" :: held 1.249s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:01:46 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-39461f45-2be6-47c9-9584-3fe0ea4ea658 Sep 04 06:01:46 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Created reservations ['84f793f0-f9de-4eef-984b-fe17d079bf23', '9725f745-2071-446c-a20c-af99158d7126', '17713527-c77d-43f8-a573-46f0374118a2', '86c1069d-67f4-4971-b9d2-869bb49fdf95'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:46 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:01:46 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:46 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-39461f45-2be6-47c9-9584-3fe0ea4ea658" returned: 0 in 0.755s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-39461f45-2be6-47c9-9584-3fe0ea4ea658 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:46 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-39461f45-2be6-47c9-9584-3fe0ea4ea658 Sep 04 06:01:46 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:47 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:01:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Deleted volume successfully. Sep 04 06:01:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0094fcf2-e587-445a-be64-8af945276fe6 tempest-VolumesActionsTest-1736543637 None] Lock "cinder-09497ae8-4e27-4eea-8693-6d7aa17ca9f4-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:01:47 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-39461f45-2be6-47c9-9584-3fe0ea4ea658" returned: 0 in 0.791s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Lock "cinder-quobyte-39461f45-2be6-47c9-9584-3fe0ea4ea658" released by "delete_volume" :: held 1.670s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:01:47 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Created reservations ['52101389-c872-4976-bcd4-adcb878e8324', 'ce6205b0-823a-480b-b450-2ee08e9f98eb', 'c461a79f-0929-4d47-8ba1-62d67c1a4735', '1496a295-1d4e-410a-8a79-b0963b7ca0b7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:01:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:01:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:01:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:48 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:01:48 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:48 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.690s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:48 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:01:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Deleted volume successfully. Sep 04 06:01:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2dc18abf-e25d-4da2-8260-c754e188276d tempest-VolumeQuotasAdminTestJSON-125652474 None] Lock "cinder-39461f45-2be6-47c9-9584-3fe0ea4ea658-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Flow 'volume_create_manager' (0664b61f-26bc-45f8-93b2-8805189ef3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13ae767-82ec-4a38-816d-c9c53500f9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13ae767-82ec-4a38-816d-c9c53500f9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1293904555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2463597f-f7f1-45d8-8ce2-54745ef495a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7ebeca75545099b301fc46088b1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:54Z,use_quota=True,user_id='d642c5e2b88945fa8c50ddc340ce3f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5de5c07-015e-4059-97df-66d1d3b62cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5de5c07-015e-4059-97df-66d1d3b62cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4144fabd-9bdc-42a4-a2a9-56a4b7a9b106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4144fabd-9bdc-42a4-a2a9-56a4b7a9b106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2463597f-f7f1-45d8-8ce2-54745ef495a7', 'volume_name': 'volume-2463597f-f7f1-45d8-8ce2-54745ef495a7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2926b655-088d-4c5a-86e7-216cf1caf041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2926b655-088d-4c5a-86e7-216cf1caf041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4124fd-6453-481d-802c-18005893939e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:54 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Volume 2463597f-f7f1-45d8-8ce2-54745ef495a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2463597f-f7f1-45d8-8ce2-54745ef495a7', 'volume_size': 1} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1293904555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2463597f-f7f1-45d8-8ce2-54745ef495a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7ebeca75545099b301fc46088b1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:54Z,use_quota=True,user_id='d642c5e2b88945fa8c50ddc340ce3f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Creating volume 2463597f-f7f1-45d8-8ce2-54745ef495a7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:01:54 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:01:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2463597f-f7f1-45d8-8ce2-54745ef495a7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:54 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2463597f-f7f1-45d8-8ce2-54745ef495a7 1073741824 Sep 04 06:01:54 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:55 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2463597f-f7f1-45d8-8ce2-54745ef495a7 1073741824" returned: 0 in 1.006s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2463597f-f7f1-45d8-8ce2-54745ef495a7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:55 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2463597f-f7f1-45d8-8ce2-54745ef495a7 Sep 04 06:01:55 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:56 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2463597f-f7f1-45d8-8ce2-54745ef495a7" returned: 0 in 0.606s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:01:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4124fd-6453-481d-802c-18005893939e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2463597f-f7f1-45d8-8ce2-54745ef495a7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14bc2339-a8b0-4fcf-b657-4c5b77451cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:01:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Volume volume-2463597f-f7f1-45d8-8ce2-54745ef495a7 (2463597f-f7f1-45d8-8ce2-54745ef495a7): created successfully Sep 04 06:01:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14bc2339-a8b0-4fcf-b657-4c5b77451cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:01:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Flow 'volume_create_manager' (0664b61f-26bc-45f8-93b2-8805189ef3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:01:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-50a9d0ed-5126-43ef-bbc2-f3691ffa05b2 tempest-VolumesActionsTest-1736543637 None] Created volume successfully. Sep 04 06:01:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "cinder-2463597f-f7f1-45d8-8ce2-54745ef495a7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:01:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-2463597f-f7f1-45d8-8ce2-54745ef495a7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:01:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "cinder-quobyte-2463597f-f7f1-45d8-8ce2-54745ef495a7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:01:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-quobyte-2463597f-f7f1-45d8-8ce2-54745ef495a7" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:01:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[01947a39-2118-4fc6-9f29-f74efcf1dc1b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:01:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2463597f-f7f1-45d8-8ce2-54745ef495a7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:58 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2463597f-f7f1-45d8-8ce2-54745ef495a7 Sep 04 06:01:58 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:59 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2463597f-f7f1-45d8-8ce2-54745ef495a7" returned: 0 in 0.738s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2463597f-f7f1-45d8-8ce2-54745ef495a7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:59 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2463597f-f7f1-45d8-8ce2-54745ef495a7 Sep 04 06:01:59 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:01:59 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Sep 04 06:01:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2463597f-f7f1-45d8-8ce2-54745ef495a7" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:01:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-quobyte-2463597f-f7f1-45d8-8ce2-54745ef495a7" released by "delete_volume" :: held 1.254s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:01:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Created reservations ['93e99db1-956a-41b7-ba76-fc632859588e', 'f2a60dbb-b64d-4455-b309-a422ead19908', '021d337f-d1ff-485e-b3b0-416c1dd19603', '62985eb0-0f8c-4817-a27b-572c10c84f2b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:01:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:01:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:01:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:01:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:01:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:01:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:01:59 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:01:59 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:00 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Deleted volume successfully. Sep 04 06:02:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8455aff-9768-44a8-a63e-94392551fb35 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-2463597f-f7f1-45d8-8ce2-54745ef495a7-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Flow 'volume_create_manager' (1a23f087-ae8a-48f3-b896-3161f2143ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b4e0b8-10ae-437f-b2d8-f1792979bca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b4e0b8-10ae-437f-b2d8-f1792979bca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1814974100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fdd4d2b-e592-4dff-a565-4750d52dc6e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7ebeca75545099b301fc46088b1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:01Z,use_quota=True,user_id='d642c5e2b88945fa8c50ddc340ce3f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3f22b2-90fe-4ddb-bcfe-1c44306d757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3f22b2-90fe-4ddb-bcfe-1c44306d757e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b9be5c-48ac-40b1-8ba2-5d81df99fbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b9be5c-48ac-40b1-8ba2-5d81df99fbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fdd4d2b-e592-4dff-a565-4750d52dc6e4', 'volume_name': 'volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17681288-8605-4820-a824-d99bbd317272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17681288-8605-4820-a824-d99bbd317272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694be8b4-42e7-451b-8e4e-de2ff59164fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Volume 5fdd4d2b-e592-4dff-a565-4750d52dc6e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4', 'volume_size': 1} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1814974100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fdd4d2b-e592-4dff-a565-4750d52dc6e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7ebeca75545099b301fc46088b1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:01Z,use_quota=True,user_id='d642c5e2b88945fa8c50ddc340ce3f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Creating volume 5fdd4d2b-e592-4dff-a565-4750d52dc6e4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:01 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:01 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4 1073741824 Sep 04 06:02:01 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:02 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4 1073741824" returned: 0 in 0.635s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:02 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4 Sep 04 06:02:02 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:02 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4" returned: 0 in 0.331s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694be8b4-42e7-451b-8e4e-de2ff59164fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6707a5db-d476-4702-94d0-c7ba99478180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Volume volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4 (5fdd4d2b-e592-4dff-a565-4750d52dc6e4): created successfully Sep 04 06:02:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6707a5db-d476-4702-94d0-c7ba99478180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Flow 'volume_create_manager' (1a23f087-ae8a-48f3-b896-3161f2143ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-07dccb5b-f263-4156-8757-af877cc6da1b tempest-VolumesActionsTest-1736543637 None] Created volume successfully. Sep 04 06:02:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "cinder-5fdd4d2b-e592-4dff-a565-4750d52dc6e4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-5fdd4d2b-e592-4dff-a565-4750d52dc6e4-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "cinder-quobyte-5fdd4d2b-e592-4dff-a565-4750d52dc6e4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-quobyte-5fdd4d2b-e592-4dff-a565-4750d52dc6e4" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f44abec-4b8f-4d60-8c94-7322fa2305fa]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:04 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4 Sep 04 06:02:04 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:04 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4" returned: 0 in 0.497s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:04 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4 Sep 04 06:02:04 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:05 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5fdd4d2b-e592-4dff-a565-4750d52dc6e4" returned: 0 in 0.522s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-quobyte-5fdd4d2b-e592-4dff-a565-4750d52dc6e4" released by "delete_volume" :: held 1.113s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:05 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Created reservations ['87926693-a892-4938-b7d4-5fc97d874309', '217cfd7c-a3d8-4e39-923a-c6b88f4b0c45', '53574308-f1bc-4e12-8447-aed31945ec08', '74b73d22-387d-4862-bb34-234311c0706f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:05 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:05 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:06 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.424s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:06 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Deleted volume successfully. Sep 04 06:02:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-454e8ec5-e23a-490a-819c-cc4c7a29ac52 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-5fdd4d2b-e592-4dff-a565-4750d52dc6e4-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Flow 'volume_create_manager' (551011bc-07aa-4542-bce2-8f0b39da2e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0634b55a-68ad-4c08-9e7e-da05d06beb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0634b55a-68ad-4c08-9e7e-da05d06beb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1636302990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045cb924-2345-454a-91c3-4acd1ee881b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7ebeca75545099b301fc46088b1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:08Z,use_quota=True,user_id='d642c5e2b88945fa8c50ddc340ce3f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9325cb9a-827a-4ee8-a38c-004615533933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9325cb9a-827a-4ee8-a38c-004615533933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ac09e9-fd25-488f-8e70-6fb20b1ec882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ac09e9-fd25-488f-8e70-6fb20b1ec882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045cb924-2345-454a-91c3-4acd1ee881b5', 'volume_name': 'volume-045cb924-2345-454a-91c3-4acd1ee881b5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df12f6a3-fffd-42a5-ab9f-ba446d4999af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df12f6a3-fffd-42a5-ab9f-ba446d4999af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c79647-f71b-4723-85f0-72b284159da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Volume 045cb924-2345-454a-91c3-4acd1ee881b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045cb924-2345-454a-91c3-4acd1ee881b5', 'volume_size': 1} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1636302990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045cb924-2345-454a-91c3-4acd1ee881b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7ebeca75545099b301fc46088b1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:08Z,use_quota=True,user_id='d642c5e2b88945fa8c50ddc340ce3f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Creating volume 045cb924-2345-454a-91c3-4acd1ee881b5 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:07 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-045cb924-2345-454a-91c3-4acd1ee881b5 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:07 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-045cb924-2345-454a-91c3-4acd1ee881b5 1073741824 Sep 04 06:02:07 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:08 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-045cb924-2345-454a-91c3-4acd1ee881b5 1073741824" returned: 0 in 0.879s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-045cb924-2345-454a-91c3-4acd1ee881b5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:08 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-045cb924-2345-454a-91c3-4acd1ee881b5 Sep 04 06:02:08 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:09 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-045cb924-2345-454a-91c3-4acd1ee881b5" returned: 0 in 0.508s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c79647-f71b-4723-85f0-72b284159da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045cb924-2345-454a-91c3-4acd1ee881b5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bc1f5c-f522-4e22-90ea-1fbdb09e8fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Volume volume-045cb924-2345-454a-91c3-4acd1ee881b5 (045cb924-2345-454a-91c3-4acd1ee881b5): created successfully Sep 04 06:02:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bc1f5c-f522-4e22-90ea-1fbdb09e8fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Flow 'volume_create_manager' (551011bc-07aa-4542-bce2-8f0b39da2e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-77914f89-4765-4760-8ddb-79987ebc719b tempest-VolumesActionsTest-1736543637 None] Created volume successfully. Sep 04 06:02:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "cinder-045cb924-2345-454a-91c3-4acd1ee881b5-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-045cb924-2345-454a-91c3-4acd1ee881b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "cinder-quobyte-045cb924-2345-454a-91c3-4acd1ee881b5" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-quobyte-045cb924-2345-454a-91c3-4acd1ee881b5" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8116a5-59b6-4553-9792-8e2f8370ba28]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-045cb924-2345-454a-91c3-4acd1ee881b5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:10 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-045cb924-2345-454a-91c3-4acd1ee881b5 Sep 04 06:02:10 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:10 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-045cb924-2345-454a-91c3-4acd1ee881b5" returned: 0 in 0.408s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-045cb924-2345-454a-91c3-4acd1ee881b5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:10 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-045cb924-2345-454a-91c3-4acd1ee881b5 Sep 04 06:02:10 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:10 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-045cb924-2345-454a-91c3-4acd1ee881b5" returned: 0 in 0.294s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-quobyte-045cb924-2345-454a-91c3-4acd1ee881b5" released by "delete_volume" :: held 0.749s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Created reservations ['790b7c99-29c1-4abe-ab59-33ebe9cd976f', 'c3ed89a7-5f48-464c-9340-a03aab8946cc', 'f8717ed2-813e-45b8-9418-b6fced8da7df', '05736f2d-cfba-482b-87ac-abc4a34a8040'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:11 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:11 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:11 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.323s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Deleted volume successfully. Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53e6fe46-1bc2-4dea-b879-6d0ed7272567 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-045cb924-2345-454a-91c3-4acd1ee881b5-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Flow 'volume_create_manager' (71bb4a25-da39-4093-ae4a-26d1e988bbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b13703-278c-4afc-8500-eea0c2ae52a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b13703-278c-4afc-8500-eea0c2ae52a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2049944609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0a9106-dd42-4948-9cfd-f117834f3a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7ebeca75545099b301fc46088b1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:12Z,use_quota=True,user_id='d642c5e2b88945fa8c50ddc340ce3f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9207a66-3f09-4bf5-994c-8d7a8ae4a5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9207a66-3f09-4bf5-994c-8d7a8ae4a5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e466f0-354d-44ae-a5bf-ee5ff62df15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e466f0-354d-44ae-a5bf-ee5ff62df15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba0a9106-dd42-4948-9cfd-f117834f3a70', 'volume_name': 'volume-ba0a9106-dd42-4948-9cfd-f117834f3a70', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9286be-8478-4f51-a92a-573df7cd69a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9286be-8478-4f51-a92a-573df7cd69a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12739f5-a9ef-43ad-9700-069e8f1d634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Volume ba0a9106-dd42-4948-9cfd-f117834f3a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba0a9106-dd42-4948-9cfd-f117834f3a70', 'volume_size': 1} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2049944609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0a9106-dd42-4948-9cfd-f117834f3a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7ebeca75545099b301fc46088b1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:12Z,use_quota=True,user_id='d642c5e2b88945fa8c50ddc340ce3f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Creating volume ba0a9106-dd42-4948-9cfd-f117834f3a70 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:12 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba0a9106-dd42-4948-9cfd-f117834f3a70 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:12 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba0a9106-dd42-4948-9cfd-f117834f3a70 1073741824 Sep 04 06:02:12 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:12 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba0a9106-dd42-4948-9cfd-f117834f3a70 1073741824" returned: 0 in 0.486s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba0a9106-dd42-4948-9cfd-f117834f3a70 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:12 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba0a9106-dd42-4948-9cfd-f117834f3a70 Sep 04 06:02:12 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:12 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba0a9106-dd42-4948-9cfd-f117834f3a70" returned: 0 in 0.272s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12739f5-a9ef-43ad-9700-069e8f1d634a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba0a9106-dd42-4948-9cfd-f117834f3a70', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcac8fa9-67fc-4f4f-ab4d-2fb240240273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Volume volume-ba0a9106-dd42-4948-9cfd-f117834f3a70 (ba0a9106-dd42-4948-9cfd-f117834f3a70): created successfully Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcac8fa9-67fc-4f4f-ab4d-2fb240240273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Flow 'volume_create_manager' (71bb4a25-da39-4093-ae4a-26d1e988bbeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2b10a26d-f2c9-497f-aa57-3e2276999d28 tempest-VolumesActionsTest-1736543637 None] Created volume successfully. Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (82464174-0cb7-4861-a912-17b089ad79b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ba6a55-eca9-4feb-bec3-afce42d26ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ba6a55-eca9-4feb-bec3-afce42d26ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1308704934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b9af09-5b48-4fbe-b71f-abb5bef690e0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:14Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4087093-9329-4f49-956e-380e00986357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4087093-9329-4f49-956e-380e00986357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17bfe88d-4f7d-48a1-ba14-dcb60e07c7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17bfe88d-4f7d-48a1-ba14-dcb60e07c7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b9af09-5b48-4fbe-b71f-abb5bef690e0', 'volume_name': 'volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f9f88f-4af6-45f8-906f-38a0fdcd77bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f9f88f-4af6-45f8-906f-38a0fdcd77bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75387d82-fdb2-4b22-8182-b7b23c5459dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Volume 66b9af09-5b48-4fbe-b71f-abb5bef690e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0', 'volume_size': 1} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1308704934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b9af09-5b48-4fbe-b71f-abb5bef690e0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:14Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Creating volume 66b9af09-5b48-4fbe-b71f-abb5bef690e0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:13 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:13 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0 1073741824 Sep 04 06:02:13 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "cinder-ba0a9106-dd42-4948-9cfd-f117834f3a70-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-ba0a9106-dd42-4948-9cfd-f117834f3a70-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "cinder-quobyte-ba0a9106-dd42-4948-9cfd-f117834f3a70" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-quobyte-ba0a9106-dd42-4948-9cfd-f117834f3a70" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[795231a9-c52b-4b32-87f6-2d3424672102]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba0a9106-dd42-4948-9cfd-f117834f3a70 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:14 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0 1073741824" returned: 0 in 0.526s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:14 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0 Sep 04 06:02:14 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:14 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba0a9106-dd42-4948-9cfd-f117834f3a70 Sep 04 06:02:14 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:14 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75387d82-fdb2-4b22-8182-b7b23c5459dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:14 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f81793-f0ad-4a08-b105-fb2d43fc9964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba0a9106-dd42-4948-9cfd-f117834f3a70" returned: 0 in 0.429s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba0a9106-dd42-4948-9cfd-f117834f3a70 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:14 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba0a9106-dd42-4948-9cfd-f117834f3a70 Sep 04 06:02:14 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Volume volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0 (66b9af09-5b48-4fbe-b71f-abb5bef690e0): created successfully Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f81793-f0ad-4a08-b105-fb2d43fc9964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (82464174-0cb7-4861-a912-17b089ad79b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-916d5ca7-e61d-4468-9858-183cb4990453 tempest-VolumesGetTest-340625814 None] Created volume successfully. Sep 04 06:02:15 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba0a9106-dd42-4948-9cfd-f117834f3a70" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-quobyte-ba0a9106-dd42-4948-9cfd-f117834f3a70" released by "delete_volume" :: held 0.759s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Created reservations ['ef630f10-e550-49c5-9e7e-6ca349798420', '86b423fc-b60d-49da-878d-b19b605978d3', 'a3eacb61-cb92-49fe-a35e-e039dbe2f0c9', 'b8568d32-6d45-4414-b887-36a3753faabc'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:15 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:15 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:15 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:15 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Deleted volume successfully. Sep 04 06:02:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e5af736-929c-4a9b-87b5-40a8bf111f29 tempest-VolumesActionsTest-1501069181 None] Lock "cinder-ba0a9106-dd42-4948-9cfd-f117834f3a70-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Flow 'volume_create_manager' (b1a1d5c2-c114-4132-a1d5-6b9e5921a879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfb2c6e-49cf-4b82-8776-04e0c999cf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfb2c6e-49cf-4b82-8776-04e0c999cf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1596569745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54eff642-b539-4d91-b416-02e08d78f095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7ebeca75545099b301fc46088b1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:16Z,use_quota=True,user_id='d642c5e2b88945fa8c50ddc340ce3f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aad3c8c-ddfc-4e93-9b60-b1490d003ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aad3c8c-ddfc-4e93-9b60-b1490d003ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77c260b-da6e-4a37-8595-b916c66112b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77c260b-da6e-4a37-8595-b916c66112b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54eff642-b539-4d91-b416-02e08d78f095', 'volume_name': 'volume-54eff642-b539-4d91-b416-02e08d78f095', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e7c86b-3c63-4463-81f8-49adf3a29895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e7c86b-3c63-4463-81f8-49adf3a29895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9fe420-4967-486f-994a-3d831c5274c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Volume 54eff642-b539-4d91-b416-02e08d78f095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54eff642-b539-4d91-b416-02e08d78f095', 'volume_size': 1} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1596569745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54eff642-b539-4d91-b416-02e08d78f095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7ebeca75545099b301fc46088b1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:16Z,use_quota=True,user_id='d642c5e2b88945fa8c50ddc340ce3f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Creating volume 54eff642-b539-4d91-b416-02e08d78f095 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:16 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54eff642-b539-4d91-b416-02e08d78f095 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:16 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54eff642-b539-4d91-b416-02e08d78f095 1073741824 Sep 04 06:02:16 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (1d087e92-f9d2-40bb-be52-f58a1ed56e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad41d80-1adc-4fde-8048-93c4288d06e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad41d80-1adc-4fde-8048-93c4288d06e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-510107784',display_name='tempest-VolumesGetTest-Volume-785781461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25494d6-963a-475b-bff9-06225d7f606a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:17Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93869845-190f-4390-86d8-794128ae58b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93869845-190f-4390-86d8-794128ae58b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2fc49fd-9415-4314-ab23-5205b9775c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2fc49fd-9415-4314-ab23-5205b9775c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25494d6-963a-475b-bff9-06225d7f606a', 'volume_name': 'volume-e25494d6-963a-475b-bff9-06225d7f606a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:16 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1bbd99-5b89-4657-aa75-6fb460232c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1bbd99-5b89-4657-aa75-6fb460232c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d67f60-ca31-4bb3-bd64-f6f264386940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Volume e25494d6-963a-475b-bff9-06225d7f606a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25494d6-963a-475b-bff9-06225d7f606a', 'volume_size': 1} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54eff642-b539-4d91-b416-02e08d78f095 1073741824" returned: 0 in 0.587s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54eff642-b539-4d91-b416-02e08d78f095 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:17 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54eff642-b539-4d91-b416-02e08d78f095 Sep 04 06:02:17 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:17 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54eff642-b539-4d91-b416-02e08d78f095" returned: 0 in 0.283s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.320s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-510107784',display_name='tempest-VolumesGetTest-Volume-785781461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25494d6-963a-475b-bff9-06225d7f606a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:17Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Creating volume e25494d6-963a-475b-bff9-06225d7f606a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:17 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e25494d6-963a-475b-bff9-06225d7f606a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9fe420-4967-486f-994a-3d831c5274c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54eff642-b539-4d91-b416-02e08d78f095', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:17 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e25494d6-963a-475b-bff9-06225d7f606a 1073741824 Sep 04 06:02:17 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b9b85b-bca4-4505-8dec-9b7cb306e579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Volume volume-54eff642-b539-4d91-b416-02e08d78f095 (54eff642-b539-4d91-b416-02e08d78f095): created successfully Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b9b85b-bca4-4505-8dec-9b7cb306e579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Flow 'volume_create_manager' (b1a1d5c2-c114-4132-a1d5-6b9e5921a879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7b631896-a1ca-4d73-8839-11f74d0a4882 tempest-VolumesActionsTest-1736543637 None] Created volume successfully. Sep 04 06:02:17 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e25494d6-963a-475b-bff9-06225d7f606a 1073741824" returned: 0 in 0.464s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e25494d6-963a-475b-bff9-06225d7f606a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:17 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e25494d6-963a-475b-bff9-06225d7f606a Sep 04 06:02:17 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:18 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e25494d6-963a-475b-bff9-06225d7f606a" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d67f60-ca31-4bb3-bd64-f6f264386940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25494d6-963a-475b-bff9-06225d7f606a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cf71bb-bf6b-45b1-8317-e1732ec0f74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Volume volume-e25494d6-963a-475b-bff9-06225d7f606a (e25494d6-963a-475b-bff9-06225d7f606a): created successfully Sep 04 06:02:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cf71bb-bf6b-45b1-8317-e1732ec0f74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (1d087e92-f9d2-40bb-be52-f58a1ed56e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2cb7dffb-4fba-466c-beea-ff62a4e71c4a tempest-VolumesGetTest-340625814 None] Created volume successfully. Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Acquiring lock "cinder-54eff642-b539-4d91-b416-02e08d78f095-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Lock "cinder-54eff642-b539-4d91-b416-02e08d78f095-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-e25494d6-963a-475b-bff9-06225d7f606a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Acquiring lock "cinder-quobyte-54eff642-b539-4d91-b416-02e08d78f095" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Lock "cinder-e25494d6-963a-475b-bff9-06225d7f606a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Lock "cinder-quobyte-54eff642-b539-4d91-b416-02e08d78f095" acquired by "delete_volume" :: waited 0.050s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d7c38-7221-4aff-94d2-c69d6c63dc30]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54eff642-b539-4d91-b416-02e08d78f095 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-quobyte-e25494d6-963a-475b-bff9-06225d7f606a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-e25494d6-963a-475b-bff9-06225d7f606a" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[625010a6-344e-4b8a-a77d-0854f0a05857]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e25494d6-963a-475b-bff9-06225d7f606a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:19 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54eff642-b539-4d91-b416-02e08d78f095 Sep 04 06:02:19 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:19 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e25494d6-963a-475b-bff9-06225d7f606a Sep 04 06:02:19 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Flow 'volume_create_manager' (a7cc18e2-4f96-498e-8292-59de5bf69426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6976fbe4-cb72-402e-b50c-e646d8980e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6976fbe4-cb72-402e-b50c-e646d8980e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-522901938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02c6d48-df1e-4fbf-93a2-fb804ba603c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f626d503b234c218bce56dc6e9f4c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:19Z,use_quota=True,user_id='c230a92d3bc44b94b65497f3de6a7bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c32aa4c-9d23-4d99-b484-8c661185b9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c32aa4c-9d23-4d99-b484-8c661185b9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b3170e-1f43-4198-a379-aaa10a0547dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b3170e-1f43-4198-a379-aaa10a0547dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02c6d48-df1e-4fbf-93a2-fb804ba603c2', 'volume_name': 'volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800c687b-0241-4e86-8e19-d320674e39ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800c687b-0241-4e86-8e19-d320674e39ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0760bc-b70e-4163-94c3-df51bd4cf759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Volume f02c6d48-df1e-4fbf-93a2-fb804ba603c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2', 'volume_size': 1} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-522901938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02c6d48-df1e-4fbf-93a2-fb804ba603c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f626d503b234c218bce56dc6e9f4c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:19Z,use_quota=True,user_id='c230a92d3bc44b94b65497f3de6a7bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Creating volume f02c6d48-df1e-4fbf-93a2-fb804ba603c2 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:19 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:19 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54eff642-b539-4d91-b416-02e08d78f095" returned: 0 in 0.417s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54eff642-b539-4d91-b416-02e08d78f095 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:19 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2 1073741824 Sep 04 06:02:19 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:19 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54eff642-b539-4d91-b416-02e08d78f095 Sep 04 06:02:19 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:19 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e25494d6-963a-475b-bff9-06225d7f606a" returned: 0 in 0.418s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e25494d6-963a-475b-bff9-06225d7f606a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:19 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e25494d6-963a-475b-bff9-06225d7f606a Sep 04 06:02:19 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:19 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54eff642-b539-4d91-b416-02e08d78f095" returned: 0 in 0.254s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Lock "cinder-quobyte-54eff642-b539-4d91-b416-02e08d78f095" released by "delete_volume" :: held 0.718s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:19 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Created reservations ['585891e6-5d74-46dd-8f3a-c92c6a6b7fa4', '52caf051-5e3f-45fb-883c-edb13ce62372', '27ae6f2e-0fd7-4d10-9b18-452be998dfc5', '5447445a-1d4e-4ac2-a296-78e85367a27d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:20 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e25494d6-963a-475b-bff9-06225d7f606a" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-e25494d6-963a-475b-bff9-06225d7f606a" released by "delete_volume" :: held 0.734s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:20 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Created reservations ['a829cd8e-335b-45c4-a2bd-27762c04cd84', '8a364aa2-0897-462a-af27-8c17dc4208f7', '2150f854-1ea5-4f1e-a16b-f5ed75efa653', '35a48544-b22e-4085-9b29-d78bffea886b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:20 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:20 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2 1073741824" returned: 0 in 0.511s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:20 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:20 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:20 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2 Sep 04 06:02:20 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:20 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.313s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Deleted volume successfully. Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b979417a-6359-40d9-831e-a1f72bec57c5 tempest-VolumesActionsTest-1736543637 None] Lock "cinder-54eff642-b539-4d91-b416-02e08d78f095-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-66b9af09-5b48-4fbe-b71f-abb5bef690e0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Lock "cinder-66b9af09-5b48-4fbe-b71f-abb5bef690e0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:20 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.395s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Deleted volume successfully. Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-quobyte-66b9af09-5b48-4fbe-b71f-abb5bef690e0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:20 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2" returned: 0 in 0.428s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-66b9af09-5b48-4fbe-b71f-abb5bef690e0" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6a461a56-98b3-4758-9566-4aa63a0f484e tempest-VolumesGetTest-340625814 None] Lock "cinder-e25494d6-963a-475b-bff9-06225d7f606a-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0760bc-b70e-4163-94c3-df51bd4cf759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203b2010-69f5-4f67-9dff-1db5c69b8ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34e4446-3328-4896-92be-aaf1881a712b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Volume volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2 (f02c6d48-df1e-4fbf-93a2-fb804ba603c2): created successfully Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203b2010-69f5-4f67-9dff-1db5c69b8ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Flow 'volume_create_manager' (a7cc18e2-4f96-498e-8292-59de5bf69426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fdd8387e-960b-44fc-ac7a-39c96a030c24 tempest-AttachVolumeTestJSON-1586140776 None] Created volume successfully. Sep 04 06:02:20 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0 Sep 04 06:02:20 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:21 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0" returned: 0 in 0.441s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:21 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0 Sep 04 06:02:21 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:21 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66b9af09-5b48-4fbe-b71f-abb5bef690e0" returned: 0 in 0.327s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-66b9af09-5b48-4fbe-b71f-abb5bef690e0" released by "delete_volume" :: held 0.834s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Created reservations ['d14752ea-2833-4395-b020-f0239f4b380e', '04e84901-4a7e-49c9-9e10-6eaee4d4b143', '01549ca0-f1db-45ed-b380-a1bc6d8b2822', '6d84273d-9cfb-4bbc-a107-80d550d9661d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:21 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:21 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:22 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Deleted volume successfully. Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-806c4ea7-424a-4449-a33b-dcd612b8ff30 tempest-VolumesGetTest-340625814 None] Lock "cinder-66b9af09-5b48-4fbe-b71f-abb5bef690e0-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (22fe067d-0c45-4dda-8897-c79dea17d606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6397eb7c-3b8f-4c56-833f-a8ce63f21fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6397eb7c-3b8f-4c56-833f-a8ce63f21fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-704010758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:23Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba4b0f8-b0a1-4a6e-9e0c-cec16db2cb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba4b0f8-b0a1-4a6e-9e0c-cec16db2cb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8021ad-88b2-4937-9dda-4ac34d9209cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8021ad-88b2-4937-9dda-4ac34d9209cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e', 'volume_name': 'volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb48979-b0e6-4a2d-9a8c-238e9de39445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb48979-b0e6-4a2d-9a8c-238e9de39445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1e4e45-c10c-480d-9930-6e0ed4e5dd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Volume fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e', 'volume_size': 1} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-704010758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:23Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Creating volume fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:22 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:22 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e 1073741824 Sep 04 06:02:22 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c3e117d1-0dd5-4814-a268-ee8390963b93 req-3f8f31a3-e8cf-4d90-8506-f1032557dc7a tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:23 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e 1073741824" returned: 0 in 0.604s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:23 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e Sep 04 06:02:23 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:23 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c3e117d1-0dd5-4814-a268-ee8390963b93 req-3f8f31a3-e8cf-4d90-8506-f1032557dc7a tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.605s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1e4e45-c10c-480d-9930-6e0ed4e5dd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496df9b0-4840-4399-b664-e996abe9b3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c3e117d1-0dd5-4814-a268-ee8390963b93 req-3f8f31a3-e8cf-4d90-8506-f1032557dc7a tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Volume volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e (fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e): created successfully Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496df9b0-4840-4399-b664-e996abe9b3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (22fe067d-0c45-4dda-8897-c79dea17d606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-c3e117d1-0dd5-4814-a268-ee8390963b93 req-3f8f31a3-e8cf-4d90-8506-f1032557dc7a tempest-AttachVolumeTestJSON-1586140776 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce184436-7fe0-4427-a15a-4a5d128e5a59', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:02:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ca95e3d8-cc24-48db-ab25-71156ca2ad83 tempest-VolumesGetTest-340625814 None] Created volume successfully. Sep 04 06:02:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-c3e117d1-0dd5-4814-a268-ee8390963b93 req-3f8f31a3-e8cf-4d90-8506-f1032557dc7a tempest-AttachVolumeTestJSON-1586140776 None] attachment_update completed successfully. Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:25 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:25 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:25 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.414s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (d408408e-f33d-4f95-a71f-aa9bbf60372f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f164c0-b07e-46ee-a146-051eb01db0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f164c0-b07e-46ee-a146-051eb01db0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-400655204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b6d7fb-bffa-4be9-954e-a4a4509f236d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:26Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963b8ceb-28ec-4c3f-9b23-84068f26682f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963b8ceb-28ec-4c3f-9b23-84068f26682f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afb31ee-da70-45be-82a0-f3bad271d813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afb31ee-da70-45be-82a0-f3bad271d813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '33b6d7fb-bffa-4be9-954e-a4a4509f236d', 'volume_name': 'volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d', 'volume_size': 1, 'source_volid': 'fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e', 'source_volstatus': 'available'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08e5a00-da13-48a9-b338-511dc8221008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08e5a00-da13-48a9-b338-511dc8221008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0570ce50-42a2-4b97-bc95-642a84a3cf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Volume 33b6d7fb-bffa-4be9-954e-a4a4509f236d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d', 'volume_size': 1, 'source_volid': 'fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e', 'source_volstatus': 'available'} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:25 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Cloning volume fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e to volume 33b6d7fb-bffa-4be9-954e-a4a4509f236d Sep 04 06:02:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Creating offline snapshot 1410b6e0-cefb-42b0-8c41-71ba5e947637 of volume fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5e1489-6c5d-415d-89de-a4c51cdbbc8c]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:26 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e Sep 04 06:02:26 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Flow 'volume_create_manager' (a8993f6e-214d-470d-881c-032c67e2442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45109657-b91d-4758-afe1-04404e508b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45109657-b91d-4758-afe1-04404e508b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1468638741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd21a04-9484-41d6-a75e-6a4f95187eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f626d503b234c218bce56dc6e9f4c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:26Z,use_quota=True,user_id='c230a92d3bc44b94b65497f3de6a7bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76ecd40-fd55-4090-a1a9-daaa82fa1dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76ecd40-fd55-4090-a1a9-daaa82fa1dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34621b76-e672-4020-89bd-3badb4f71971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34621b76-e672-4020-89bd-3badb4f71971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cd21a04-9484-41d6-a75e-6a4f95187eef', 'volume_name': 'volume-5cd21a04-9484-41d6-a75e-6a4f95187eef', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b42bf27-bcd9-4b99-af67-f289230f0c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b42bf27-bcd9-4b99-af67-f289230f0c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7de9d57-d65b-4a23-86cb-c3f4677a625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Volume 5cd21a04-9484-41d6-a75e-6a4f95187eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cd21a04-9484-41d6-a75e-6a4f95187eef', 'volume_size': 1} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:26 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e" returned: 0 in 0.498s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:26 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 1G Sep 04 06:02:26 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:27 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 1G" returned: 0 in 0.507s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:27 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 Sep 04 06:02:27 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:27 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:27 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 is being set with open permissions: ugo+rw Sep 04 06:02:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:27 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 Sep 04 06:02:27 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:27 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637" returned: 0 in 0.281s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:27 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.info Sep 04 06:02:27 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:27 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.info" returned: 0 in 0.288s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:27 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.info is being set with open permissions: ugo+rw Sep 04 06:02:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:28 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.info Sep 04 06:02:28 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:28 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.info" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-quobyte-33b6d7fb-bffa-4be9-954e-a4a4509f236d" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-33b6d7fb-bffa-4be9-954e-a4a4509f236d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] snapshot: 1410b6e0-cefb-42b0-8c41-71ba5e947637, volume: 33b6d7fb-bffa-4be9-954e-a4a4509f236d, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f930e9-f5d3-4682-bf26-8bb33256ab32]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:28 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 Sep 04 06:02:28 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:28 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0249cd6-f517-4a11-875a-6f31067da750]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:28 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e Sep 04 06:02:28 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:29 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e" returned: 0 in 0.442s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] will copy from snapshot at /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Path /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:29 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d Sep 04 06:02:29 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Flow 'volume_create_manager' (c2cc4753-b3d8-4d9b-8038-cf90484fdfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308aea7a-d2e4-4aa1-9f66-5a3e41fc88ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308aea7a-d2e4-4aa1-9f66-5a3e41fc88ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1696425720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b11140-6924-40c0-ae0f-e54dfbdb3352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d06b0a8d0b4e8a9bbb432b2fbe086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:30Z,use_quota=True,user_id='ecf22ca64c0f4ebdb749d57d11d01a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30e1363-9bcc-4832-aa3e-f96e8e748a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30e1363-9bcc-4832-aa3e-f96e8e748a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6320694e-5736-47b6-b08f-7c1b2a257f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6320694e-5736-47b6-b08f-7c1b2a257f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b11140-6924-40c0-ae0f-e54dfbdb3352', 'volume_name': 'volume-41b11140-6924-40c0-ae0f-e54dfbdb3352', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6130285f-a9f9-425d-b905-569db3317dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6130285f-a9f9-425d-b905-569db3317dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d4d78e-95bd-4568-a249-cf68820ba1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Volume 41b11140-6924-40c0-ae0f-e54dfbdb3352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b11140-6924-40c0-ae0f-e54dfbdb3352', 'volume_size': 1} Sep 04 06:02:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:34 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d" returned: 0 in 4.837s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:02:34 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Converted 1024.00 MB image at 211.65 MB/s Sep 04 06:02:34 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d is being set with open permissions: ugo+rw Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:34 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d Sep 04 06:02:34 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:34 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d" returned: 0 in 0.257s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-33b6d7fb-bffa-4be9-954e-a4a4509f236d" released by "_copy_volume_from_snapshot" :: held 5.987s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=118,cinder:SELECT=106,cinder:INSERT=26,cinder:DELETE=14 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-quobyte-1410b6e0-cefb-42b0-8c41-71ba5e947637" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-1410b6e0-cefb-42b0-8c41-71ba5e947637" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Deleting offline snapshot 1410b6e0-cefb-42b0-8c41-71ba5e947637 of volume fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] snapshot_file for this snap is: volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b811a9f-702b-4102-abf8-1a036443fecb]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:34 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 Sep 04 06:02:34 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:34 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637" returned: 0 in 0.402s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e240c38c-59d0-4650-b5e6-a2df84c5bf70]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:34 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e Sep 04 06:02:34 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:35 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e" returned: 0 in 0.546s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:35 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 Sep 04 06:02:35 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:35 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637" returned: 0 in 0.367s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:35 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637 Sep 04 06:02:35 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:35 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e.1410b6e0-cefb-42b0-8c41-71ba5e947637" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-1410b6e0-cefb-42b0-8c41-71ba5e947637" released by "_delete_snapshot" :: held 1.672s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=105,cinder:UPDATE=140,cinder:INSERT=31,cinder:DELETE=9 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.136s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.639s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1468638741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd21a04-9484-41d6-a75e-6a4f95187eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f626d503b234c218bce56dc6e9f4c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:26Z,use_quota=True,user_id='c230a92d3bc44b94b65497f3de6a7bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Creating volume 5cd21a04-9484-41d6-a75e-6a4f95187eef {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:36 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5cd21a04-9484-41d6-a75e-6a4f95187eef 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:36 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5cd21a04-9484-41d6-a75e-6a4f95187eef 1073741824 Sep 04 06:02:36 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0570ce50-42a2-4b97-bc95-642a84a3cf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d', 'volume_size': 1, 'source_volid': 'fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e', 'source_volstatus': 'available'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa21d6e5-8f78-493e-ab9b-fb05592aefca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Volume volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d (33b6d7fb-bffa-4be9-954e-a4a4509f236d): created successfully Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa21d6e5-8f78-493e-ab9b-fb05592aefca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (d408408e-f33d-4f95-a71f-aa9bbf60372f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-beb9f5dd-d4e3-4416-bc1c-0f9e8c82870a tempest-VolumesGetTest-340625814 None] Created volume successfully. Sep 04 06:02:36 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5cd21a04-9484-41d6-a75e-6a4f95187eef 1073741824" returned: 0 in 0.468s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5cd21a04-9484-41d6-a75e-6a4f95187eef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:36 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5cd21a04-9484-41d6-a75e-6a4f95187eef Sep 04 06:02:36 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:36 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5cd21a04-9484-41d6-a75e-6a4f95187eef" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.991s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1696425720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b11140-6924-40c0-ae0f-e54dfbdb3352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d06b0a8d0b4e8a9bbb432b2fbe086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:30Z,use_quota=True,user_id='ecf22ca64c0f4ebdb749d57d11d01a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Creating volume 41b11140-6924-40c0-ae0f-e54dfbdb3352 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:36 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-41b11140-6924-40c0-ae0f-e54dfbdb3352 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7de9d57-d65b-4a23-86cb-c3f4677a625b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd21a04-9484-41d6-a75e-6a4f95187eef', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5162b7c5-eef3-4a2d-b8d4-cd65affafc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:36 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-41b11140-6924-40c0-ae0f-e54dfbdb3352 1073741824 Sep 04 06:02:36 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Volume volume-5cd21a04-9484-41d6-a75e-6a4f95187eef (5cd21a04-9484-41d6-a75e-6a4f95187eef): created successfully Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5162b7c5-eef3-4a2d-b8d4-cd65affafc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Flow 'volume_create_manager' (a8993f6e-214d-470d-881c-032c67e2442d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-db06d83a-c3cf-4ccd-81bb-1b9929afe998 tempest-AttachVolumeTestJSON-1586140776 None] Created volume successfully. Sep 04 06:02:37 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-41b11140-6924-40c0-ae0f-e54dfbdb3352 1073741824" returned: 0 in 0.638s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (9e242d91-b219-4b72-833d-3eb002f7d57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189b4b67-71fc-4da9-bb56-6e0859c50acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189b4b67-71fc-4da9-bb56-6e0859c50acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1564273193',display_name='tempest-VolumesGetTest-Volume-2125417002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:37Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ba64c8-85ed-4d84-92a8-8e3147b2dec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ba64c8-85ed-4d84-92a8-8e3147b2dec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2befc884-fdd1-48c4-bf54-e56bfcf9daa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2befc884-fdd1-48c4-bf54-e56bfcf9daa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c', 'volume_name': 'volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7ba4f2-346e-422f-9f8b-e62f3a16130e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7ba4f2-346e-422f-9f8b-e62f3a16130e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57daebe-9844-4b99-8415-d718103da28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Volume df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c', 'volume_size': 1} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-41b11140-6924-40c0-ae0f-e54dfbdb3352 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:37 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-41b11140-6924-40c0-ae0f-e54dfbdb3352 Sep 04 06:02:37 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:37 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-41b11140-6924-40c0-ae0f-e54dfbdb3352" returned: 0 in 0.259s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.282s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1564273193',display_name='tempest-VolumesGetTest-Volume-2125417002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:37Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Creating volume df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:37 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d4d78e-95bd-4568-a249-cf68820ba1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b11140-6924-40c0-ae0f-e54dfbdb3352', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:37 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c 1073741824 Sep 04 06:02:37 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4053777-d495-4da5-a8df-37994ae87909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Volume volume-41b11140-6924-40c0-ae0f-e54dfbdb3352 (41b11140-6924-40c0-ae0f-e54dfbdb3352): created successfully Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4053777-d495-4da5-a8df-37994ae87909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Flow 'volume_create_manager' (c2cc4753-b3d8-4d9b-8038-cf90484fdfa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4803ac02-32d6-4067-961b-7f4cc06ebd80 tempest-AttachVolumeNegativeTest-1175679777 None] Created volume successfully. Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-e2893281-82a6-4b81-9ec8-94e7a3e26bd9 req-e71050ac-88e2-4e7b-a115-cffd71e17b20 tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Flow 'volume_create_manager' (46865fc0-644b-410e-a5a2-ecc3dd501d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb922d9-7823-48b6-acd4-90c0f16fe717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb922d9-7823-48b6-acd4-90c0f16fe717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1590682414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee565f00-de7c-409d-800a-c27db5a3ba28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c349e3fb34b44c53bc54fd39d8a26541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:38Z,use_quota=True,user_id='8c6a8fd84d9a47da8070a84dfb5c46e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c85ffef-5253-4bd9-a670-4ee9e2cd04d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c85ffef-5253-4bd9-a670-4ee9e2cd04d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:38 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd125b1d-187a-4d1e-8635-e29d35884798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c 1073741824" returned: 0 in 0.615s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:38 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c Sep 04 06:02:38 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:38 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c" returned: 0 in 0.301s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-e2893281-82a6-4b81-9ec8-94e7a3e26bd9 req-e71050ac-88e2-4e7b-a115-cffd71e17b20 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.507s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd125b1d-187a-4d1e-8635-e29d35884798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee565f00-de7c-409d-800a-c27db5a3ba28', 'volume_name': 'volume-ee565f00-de7c-409d-800a-c27db5a3ba28', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3c25cb-ee82-4c93-b8ca-60fee4fee133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3c25cb-ee82-4c93-b8ca-60fee4fee133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f40de24-6e86-4771-b855-e2dc9964cafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Volume ee565f00-de7c-409d-800a-c27db5a3ba28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee565f00-de7c-409d-800a-c27db5a3ba28', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Trying to clone ee565f00-de7c-409d-800a-c27db5a3ba28 from image e49bac44-c124-47bb-b839-5895be946aa9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57daebe-9844-4b99-8415-d718103da28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac60703e-904b-43f7-bbc7-546b61b89a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-e2893281-82a6-4b81-9ec8-94e7a3e26bd9 req-e71050ac-88e2-4e7b-a115-cffd71e17b20 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Volume volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c (df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c): created successfully Sep 04 06:02:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac60703e-904b-43f7-bbc7-546b61b89a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (9e242d91-b219-4b72-833d-3eb002f7d57a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e3b72c4f-0987-4571-9ec8-a2850bb14476 tempest-VolumesGetTest-340625814 None] Created volume successfully. Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-e2893281-82a6-4b81-9ec8-94e7a3e26bd9 req-e71050ac-88e2-4e7b-a115-cffd71e17b20 tempest-AttachVolumeTestJSON-1586140776 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-5cd21a04-9484-41d6-a75e-6a4f95187eef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bccf3d5-0000-43c0-b593-6d6e5699ddfb', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:02:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-e2893281-82a6-4b81-9ec8-94e7a3e26bd9 req-e71050ac-88e2-4e7b-a115-cffd71e17b20 tempest-AttachVolumeTestJSON-1586140776 None] attachment_update completed successfully. Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 06:02:39 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Image download 20.69 MB at 20.69 MB/s Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6706b1ba-e94f-4ed4-98f3-bf7bb9fc2f8d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-90794f3b-6fb8-40d1-b0fb-11181c6ef37a req-0987db21-7718-41ad-a8f6-5fc852941660 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-90794f3b-6fb8-40d1-b0fb-11181c6ef37a req-0987db21-7718-41ad-a8f6-5fc852941660 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-90794f3b-6fb8-40d1-b0fb-11181c6ef37a req-0987db21-7718-41ad-a8f6-5fc852941660 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-90794f3b-6fb8-40d1-b0fb-11181c6ef37a req-0987db21-7718-41ad-a8f6-5fc852941660 tempest-AttachVolumeNegativeTest-1175679777 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-41b11140-6924-40c0-ae0f-e54dfbdb3352', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a732646a-8ca7-432f-a839-765cd2b15c26', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:02:39 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD Sep 04 06:02:39 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-90794f3b-6fb8-40d1-b0fb-11181c6ef37a req-0987db21-7718-41ad-a8f6-5fc852941660 tempest-AttachVolumeNegativeTest-1175679777 None] attachment_update completed successfully. Sep 04 06:02:39 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Temporary image e49bac44-c124-47bb-b839-5895be946aa9 is fetched for user 8c6a8fd84d9a47da8070a84dfb5c46e0. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Lock "cinder-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce3b80a-bfb4-4058-b2c0-3d8080e4a146]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-quobyte-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aad45b-b14b-4c71-9099-017f03491bde]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:40 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD Sep 04 06:02:40 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:40 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c Sep 04 06:02:40 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:40 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1590682414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee565f00-de7c-409d-800a-c27db5a3ba28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c349e3fb34b44c53bc54fd39d8a26541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:38Z,use_quota=True,user_id='8c6a8fd84d9a47da8070a84dfb5c46e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Creating volume ee565f00-de7c-409d-800a-c27db5a3ba28 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:40 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:40 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 1073741824 Sep 04 06:02:40 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:40 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c" returned: 0 in 0.435s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:40 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c Sep 04 06:02:40 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:40 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c" released by "delete_volume" :: held 0.762s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Created reservations ['97bbf2c6-40ba-4748-9b8d-5e67a8142d60', '8e88388c-ce6f-4e94-b3f3-06da868bee89', 'ae57c7af-3512-4263-b498-ea0b670527ea', '2bb80640-35ad-4a87-aad3-e66d32d28c8e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:40 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 1073741824" returned: 0 in 0.560s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:41 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:41 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:41 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 Sep 04 06:02:41 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-33b6d7fb-bffa-4be9-954e-a4a4509f236d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Lock "cinder-33b6d7fb-bffa-4be9-954e-a4a4509f236d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:41 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Deleted volume successfully. Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cc1483d5-0c99-4c3c-b114-d7a7033220ba tempest-VolumesGetTest-340625814 None] Lock "cinder-df1bd66c-bf7f-4b4e-a912-6ac2840f0c0c-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:41 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28" returned: 0 in 0.355s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-quobyte-33b6d7fb-bffa-4be9-954e-a4a4509f236d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-33b6d7fb-bffa-4be9-954e-a4a4509f236d" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-987d0e36-9a6b-43d7-8af2-5183c21f01f4 req-49101ce3-c067-4ad8-bbbd-66bf3824b9f8 tempest-AttachVolumeTestJSON-1586140776 None] Terminate volume connection completed successfully. Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-987d0e36-9a6b-43d7-8af2-5183c21f01f4 req-49101ce3-c067-4ad8-bbbd-66bf3824b9f8 tempest-AttachVolumeTestJSON-1586140776 None] Deleting attachment ce184436-7fe0-4427-a15a-4a5d128e5a59. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Attempting download of e49bac44-c124-47bb-b839-5895be946aa9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}])) to volume ee565f00-de7c-409d-800a-c27db5a3ba28. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a04894a-c6d6-4101-afae-b1f40dd24d29]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f9a917-9ee7-4cb1-9ddc-cd1a5cd20ffc]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9__5jejiy7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:41 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d Sep 04 06:02:41 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:41 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9__5jejiy7 Sep 04 06:02:41 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:41 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9__5jejiy7" returned: 0 in 0.395s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9__5jejiy7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:41 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d" returned: 0 in 0.474s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:41 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d Sep 04 06:02:41 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:42 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9__5jejiy7 Sep 04 06:02:42 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:42 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-33b6d7fb-bffa-4be9-954e-a4a4509f236d" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-33b6d7fb-bffa-4be9-954e-a4a4509f236d" released by "delete_volume" :: held 0.809s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Created reservations ['455d1f99-8e45-4efb-9b2a-734376299708', '7520636b-5b88-4772-b0c3-4748139e8494', '4b1a06d8-48a1-47cf-9470-2d3531f207bc', '12ecb23a-0d28-490e-8a51-d532d13113d0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:42 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9__5jejiy7" returned: 1 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9__5jejiy7' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a43711-a440-485d-be47-2cfe1e273c5c]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-29cafb63-3f27-4b21-bd50-ed4d1f1e555e req-e8b51688-2770-465a-a61d-b696421894e7 tempest-AttachVolumeNegativeTest-1175679777 None] Terminate volume connection completed successfully. Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-29cafb63-3f27-4b21-bd50-ed4d1f1e555e req-e8b51688-2770-465a-a61d-b696421894e7 tempest-AttachVolumeNegativeTest-1175679777 None] Deleting attachment a732646a-8ca7-432f-a839-765cd2b15c26. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:42 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD Sep 04 06:02:42 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:42 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:42 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:42 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] e49bac44-c124-47bb-b839-5895be946aa9 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:42 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 Sep 04 06:02:42 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Lock "cinder-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:42 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Deleted volume successfully. Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-quobyte-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a60e355b-4db5-42ef-ac2f-aed28af2ccc7 tempest-VolumesGetTest-340625814 None] Lock "cinder-33b6d7fb-bffa-4be9-954e-a4a4509f236d-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d155332-5913-4472-93b9-c601fc659a17]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:43 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e Sep 04 06:02:43 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-711f7628-1663-4379-9c39-2253dc24919e req-023eaed4-e08c-4d18-aff1-11627d0a1429 tempest-AttachVolumeTestJSON-1586140776 None] Terminate volume connection completed successfully. Sep 04 06:02:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-711f7628-1663-4379-9c39-2253dc24919e req-023eaed4-e08c-4d18-aff1-11627d0a1429 tempest-AttachVolumeTestJSON-1586140776 None] Deleting attachment 8bccf3d5-0000-43c0-b593-6d6e5699ddfb. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:02:43 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e" returned: 0 in 0.541s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:43 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e Sep 04 06:02:43 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:43 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e" returned: 0 in 0.497s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e" released by "delete_volume" :: held 1.126s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:44 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Created reservations ['4a01f9d6-f0fa-46f4-8f7b-165816ba3cfd', 'e8ad97c0-5c04-48e1-a16e-cfa2fe0a672f', 'da7ff0ee-5ea3-416c-b629-4e851de0e5cf', 'ef42bd7b-429b-4fcf-ac9d-5b0c0fe2d4ca'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:44 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:44 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:44 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.490s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:44 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Deleted volume successfully. Sep 04 06:02:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-91493684-ab8b-4d92-be3b-1af39623f822 tempest-VolumesGetTest-340625814 None] Lock "cinder-fef5b6e9-d6d7-406f-b1e6-1f6f0925a27e-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:45 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28" returned: 0 in 2.984s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:45 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_i0e1gc3idevstack@QuobyteHD, size 112.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:02:45 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Converted 112.00 MB image at 37.52 MB/s Sep 04 06:02:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:45 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 1G Sep 04 06:02:45 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:46 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 1G" returned: 0 in 0.556s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Downloaded image e49bac44-c124-47bb-b839-5895be946aa9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}])) to volume ee565f00-de7c-409d-800a-c27db5a3ba28 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Temporary image e49bac44-c124-47bb-b839-5895be946aa9 for user 8c6a8fd84d9a47da8070a84dfb5c46e0 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Marking volume ee565f00-de7c-409d-800a-c27db5a3ba28 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Copying metadata from image e49bac44-c124-47bb-b839-5895be946aa9 to ee565f00-de7c-409d-800a-c27db5a3ba28. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Creating volume glance metadata for volume ee565f00-de7c-409d-800a-c27db5a3ba28 backed by image e49bac44-c124-47bb-b839-5895be946aa9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (abed13f9-e318-4bec-b91a-4f3fe8d15276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cb11d3-6dfb-466b-8917-86a9d9c65402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cb11d3-6dfb-466b-8917-86a9d9c65402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1085225179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fd1c78-a6e6-42ed-b62c-5f11feb90858,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:46Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1f4d3b-6905-4cd5-b466-9beb708bff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1f4d3b-6905-4cd5-b466-9beb708bff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1067c5a3-aa2f-4a08-ac57-0ef46f46c780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f40de24-6e86-4771-b855-e2dc9964cafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee565f00-de7c-409d-800a-c27db5a3ba28', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a54e63e-f49a-4e2e-873e-dd588ee0bbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:46 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Volume volume-ee565f00-de7c-409d-800a-c27db5a3ba28 (ee565f00-de7c-409d-800a-c27db5a3ba28): created successfully Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a54e63e-f49a-4e2e-873e-dd588ee0bbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Flow 'volume_create_manager' (46865fc0-644b-410e-a5a2-ecc3dd501d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c4008d46-777c-4936-9fd0-1b1db8b1095d tempest-VolumesImageMetadata-2051104896 None] Created volume successfully. Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1067c5a3-aa2f-4a08-ac57-0ef46f46c780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79fd1c78-a6e6-42ed-b62c-5f11feb90858', 'volume_name': 'volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf5a7cf-1e6e-4102-855f-7caa917307f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf5a7cf-1e6e-4102-855f-7caa917307f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ae97d5-0a0b-4d97-ad14-6ad25360b8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Volume 79fd1c78-a6e6-42ed-b62c-5f11feb90858: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Trying to clone 79fd1c78-a6e6-42ed-b62c-5f11feb90858 from image e49bac44-c124-47bb-b839-5895be946aa9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 06:02:47 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Image download 20.69 MB at 20.69 MB/s Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3fac93-4a07-4917-aaeb-5f3014f02282]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:47 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD Sep 04 06:02:47 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Acquiring lock "cinder-ee565f00-de7c-409d-800a-c27db5a3ba28-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Lock "cinder-ee565f00-de7c-409d-800a-c27db5a3ba28-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:47 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Temporary image e49bac44-c124-47bb-b839-5895be946aa9 is fetched for user 22820a4063424b31b8b2f5d78b958940. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Acquiring lock "cinder-quobyte-ee565f00-de7c-409d-800a-c27db5a3ba28" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Lock "cinder-quobyte-ee565f00-de7c-409d-800a-c27db5a3ba28" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d53471-8490-4c83-9a8c-5253bd8bdc3d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d988e914-84ee-4eaf-9b12-ec1c41fbe1c5]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:48 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 Sep 04 06:02:48 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:48 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD Sep 04 06:02:48 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:48 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28" returned: 0 in 0.523s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:48 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28 Sep 04 06:02:48 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:48 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1085225179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fd1c78-a6e6-42ed-b62c-5f11feb90858,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:46Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Creating volume 79fd1c78-a6e6-42ed-b62c-5f11feb90858 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:48 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:48 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 1073741824 Sep 04 06:02:48 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:48 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ee565f00-de7c-409d-800a-c27db5a3ba28" returned: 0 in 0.389s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Lock "cinder-quobyte-ee565f00-de7c-409d-800a-c27db5a3ba28" released by "delete_volume" :: held 0.980s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Created reservations ['1a6f7ed0-2c3e-4a9b-8b41-a2683cb5ab2e', '83b60b4c-f5f6-4df7-8f24-67f4ee73c9cb', 'bc09f44b-099f-4a69-bde0-552ed7b9b861', '036ce9a3-32cc-46a5-88d0-3bfdf8c1d242'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:49 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:49 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:49 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 1073741824" returned: 0 in 0.659s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:49 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 Sep 04 06:02:49 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:49 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Deleted volume successfully. Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8d8f066d-9930-4ebf-a9ba-2cbc397c18c1 tempest-VolumesImageMetadata-2051104896 None] Lock "cinder-ee565f00-de7c-409d-800a-c27db5a3ba28-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "cinder-41b11140-6924-40c0-ae0f-e54dfbdb3352-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "cinder-41b11140-6924-40c0-ae0f-e54dfbdb3352-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:49 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858" returned: 0 in 0.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "cinder-quobyte-41b11140-6924-40c0-ae0f-e54dfbdb3352" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "cinder-quobyte-41b11140-6924-40c0-ae0f-e54dfbdb3352" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ff2b98-155b-4ac2-a0e5-5b42bdfb731b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-41b11140-6924-40c0-ae0f-e54dfbdb3352 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Attempting download of e49bac44-c124-47bb-b839-5895be946aa9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}])) to volume 79fd1c78-a6e6-42ed-b62c-5f11feb90858. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f8c6ed-3371-4617-9e33-f35d9679ebf8]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_sgky0m33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:49 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-41b11140-6924-40c0-ae0f-e54dfbdb3352 Sep 04 06:02:49 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:49 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_sgky0m33 Sep 04 06:02:49 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:50 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-41b11140-6924-40c0-ae0f-e54dfbdb3352" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-41b11140-6924-40c0-ae0f-e54dfbdb3352 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:50 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-41b11140-6924-40c0-ae0f-e54dfbdb3352 Sep 04 06:02:50 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:50 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_sgky0m33" returned: 0 in 0.476s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_sgky0m33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:50 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_sgky0m33 Sep 04 06:02:50 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:50 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-41b11140-6924-40c0-ae0f-e54dfbdb3352" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "cinder-quobyte-41b11140-6924-40c0-ae0f-e54dfbdb3352" released by "delete_volume" :: held 0.829s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Created reservations ['ee6c9ebd-8b44-45d9-ab4e-d60be80db368', '0913acd4-ec95-4591-9407-f556f8b4fdbe', '49e9e6d6-3fc1-4d20-ae1c-d5bdf141d30b', 'f8b972b7-04f1-4c93-9abd-41b0d220d50f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:50 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_sgky0m33" returned: 1 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_sgky0m33' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e187719f-33c3-4852-940c-d2c35984a246]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:50 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:50 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:50 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD Sep 04 06:02:50 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "cinder-1193d9f8-d653-41e0-a47a-8269cc4b6e78-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "cinder-1193d9f8-d653-41e0-a47a-8269cc4b6e78-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "cinder-5cd21a04-9484-41d6-a75e-6a4f95187eef-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "cinder-quobyte-1193d9f8-d653-41e0-a47a-8269cc4b6e78" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Lock "cinder-5cd21a04-9484-41d6-a75e-6a4f95187eef-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "cinder-quobyte-1193d9f8-d653-41e0-a47a-8269cc4b6e78" acquired by "delete_volume" :: waited 0.052s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4c7d37-a0c5-48c5-b196-cbe17b4cb34d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "cinder-quobyte-5cd21a04-9484-41d6-a75e-6a4f95187eef" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Lock "cinder-quobyte-5cd21a04-9484-41d6-a75e-6a4f95187eef" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:51 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:51 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD" returned: 0 in 0.636s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] e49bac44-c124-47bb-b839-5895be946aa9 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea587e0-3baa-44db-849d-50df1b61679f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Deleted volume successfully. Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5cd21a04-9484-41d6-a75e-6a4f95187eef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:51 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 Sep 04 06:02:51 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6db4b267-80ea-4194-8d61-29c97d5593e0 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "cinder-41b11140-6924-40c0-ae0f-e54dfbdb3352-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:51 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78 Sep 04 06:02:51 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:51 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5cd21a04-9484-41d6-a75e-6a4f95187eef Sep 04 06:02:51 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:51 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78" returned: 0 in 0.537s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:51 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78 Sep 04 06:02:51 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:51 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5cd21a04-9484-41d6-a75e-6a4f95187eef" returned: 0 in 0.521s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5cd21a04-9484-41d6-a75e-6a4f95187eef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:51 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5cd21a04-9484-41d6-a75e-6a4f95187eef Sep 04 06:02:51 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:52 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1193d9f8-d653-41e0-a47a-8269cc4b6e78" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "cinder-quobyte-1193d9f8-d653-41e0-a47a-8269cc4b6e78" released by "delete_volume" :: held 0.997s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:52 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5cd21a04-9484-41d6-a75e-6a4f95187eef" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Lock "cinder-quobyte-5cd21a04-9484-41d6-a75e-6a4f95187eef" released by "delete_volume" :: held 1.028s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Created reservations ['cfbb74ce-336f-41b7-8ede-3d7e82882aa1', '3c96dba3-d803-4bec-93f9-95a2309ad533', '4c9671cd-2489-47cd-b7a0-6b4864242d02', '16a74413-f9b6-4904-ba0e-dd08debe95e3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Created reservations ['769b4109-b207-4279-8216-309dd56e3d0b', 'fa0b5f57-f503-426c-b3d4-21593d7e26e1', '5e389aa8-7663-4c0c-9191-a9a4f5ea909e', 'fc3d7688-804b-4d00-bc7c-5ff79a9fb95e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:52 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:52 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:52 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:52 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:52 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Deleted volume successfully. Sep 04 06:02:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9cd77e5-6fd1-4a57-a6be-864fa71ef9b3 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "cinder-1193d9f8-d653-41e0-a47a-8269cc4b6e78-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:53 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.459s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Deleted volume successfully. Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c2f0665-10e2-4aec-acd3-0bb9139543f6 tempest-AttachVolumeTestJSON-1586140776 None] Lock "cinder-5cd21a04-9484-41d6-a75e-6a4f95187eef-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "cinder-f02c6d48-df1e-4fbf-93a2-fb804ba603c2-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Lock "cinder-f02c6d48-df1e-4fbf-93a2-fb804ba603c2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "cinder-quobyte-f02c6d48-df1e-4fbf-93a2-fb804ba603c2" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Lock "cinder-quobyte-f02c6d48-df1e-4fbf-93a2-fb804ba603c2" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f4ae9c-e82c-4214-bf1b-8f092fc725cb]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "cinder-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "cinder-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:53 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2 Sep 04 06:02:53 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "cinder-quobyte-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:53 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858" returned: 0 in 2.495s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_siq6gkfedevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:02:53 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Converted 112.00 MB image at 44.84 MB/s Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "cinder-quobyte-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:53 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 1G Sep 04 06:02:53 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abcb9bb-74aa-4971-bacf-963b488e4170]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:54 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd Sep 04 06:02:54 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:54 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2" returned: 0 in 0.501s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:54 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2 Sep 04 06:02:54 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:54 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 1G" returned: 0 in 0.410s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Downloaded image e49bac44-c124-47bb-b839-5895be946aa9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}])) to volume 79fd1c78-a6e6-42ed-b62c-5f11feb90858 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Temporary image e49bac44-c124-47bb-b839-5895be946aa9 for user 22820a4063424b31b8b2f5d78b958940 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Marking volume 79fd1c78-a6e6-42ed-b62c-5f11feb90858 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Copying metadata from image e49bac44-c124-47bb-b839-5895be946aa9 to 79fd1c78-a6e6-42ed-b62c-5f11feb90858. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Creating volume glance metadata for volume 79fd1c78-a6e6-42ed-b62c-5f11feb90858 backed by image e49bac44-c124-47bb-b839-5895be946aa9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 06:02:54 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ae97d5-0a0b-4d97-ad14-6ad25360b8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:54 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75224ac-f802-45fa-b355-552baf8c60c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:54 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:54 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Volume volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 (79fd1c78-a6e6-42ed-b62c-5f11feb90858): created successfully Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75224ac-f802-45fa-b355-552baf8c60c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:54 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (abed13f9-e318-4bec-b91a-4f3fe8d15276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f02c6d48-df1e-4fbf-93a2-fb804ba603c2" returned: 0 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Lock "cinder-quobyte-f02c6d48-df1e-4fbf-93a2-fb804ba603c2" released by "delete_volume" :: held 0.897s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3c31c8f7-326f-42f4-82ac-155d77c11c59 tempest-VolumesGetTest-340625814 None] Created volume successfully. Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Created reservations ['0177af9e-7002-4f5a-9676-581d68785097', '2165871c-d30e-4359-81e2-f6369adca6e4', '3482d5e4-a199-46fc-af47-28a330d183d1', '00db7d94-f610-4f29-b91d-c2a18b82f092'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:54 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:54 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:54 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Flow 'volume_create_manager' (a6a9cd91-515f-4ddf-b4b8-6e944acf167c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b03962-0f56-40b5-9a68-33468ec08a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "cinder-quobyte-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd" released by "delete_volume" :: held 0.932s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b03962-0f56-40b5-9a68-33468ec08a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1034652822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6c40e3-f884-4d14-ae71-a50d10875ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0afae433d34704bea633451b3804ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:55Z,use_quota=True,user_id='46a4a346a54142dc8597f9863e61616c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06288466-781b-4f4b-a5db-fa71fe122b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06288466-781b-4f4b-a5db-fa71fe122b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a83183-0f03-4c09-918d-20fb3595578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a83183-0f03-4c09-918d-20fb3595578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce6c40e3-f884-4d14-ae71-a50d10875ca5', 'volume_name': 'volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72264098-2f7c-4577-a35d-e902e1dbea7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72264098-2f7c-4577-a35d-e902e1dbea7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa124be-9c35-4f46-b2f2-ffc89e6a7eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:54 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Volume ce6c40e3-f884-4d14-ae71-a50d10875ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5', 'volume_size': 1} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1034652822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6c40e3-f884-4d14-ae71-a50d10875ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0afae433d34704bea633451b3804ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:55Z,use_quota=True,user_id='46a4a346a54142dc8597f9863e61616c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Creating volume ce6c40e3-f884-4d14-ae71-a50d10875ca5 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:54 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "cinder-1bc14e61-9b39-48b1-84a1-ff894b369e1e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:54 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5 1073741824 Sep 04 06:02:54 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Lock "cinder-1bc14e61-9b39-48b1-84a1-ff894b369e1e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Created reservations ['8fc9ec63-92dc-473a-902b-05c3dd5e9035', '3c433714-bb2d-481e-9d49-18835ed75ec2', 'ec478f7b-7a14-480c-9bce-7f2290ca534d', '24356746-c11b-4fa9-b008-bfbfaf039a5f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "cinder-quobyte-1bc14e61-9b39-48b1-84a1-ff894b369e1e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Lock "cinder-quobyte-1bc14e61-9b39-48b1-84a1-ff894b369e1e" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:54 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:54 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Deleted volume successfully. Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfbe575-9c54-4086-8350-1eccc8b29c62]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-24c1b9bd-2907-43a5-86dd-3f9bd6f6d9bc tempest-AttachVolumeTestJSON-1586140776 None] Lock "cinder-f02c6d48-df1e-4fbf-93a2-fb804ba603c2-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:55 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:55 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:55 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e Sep 04 06:02:55 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:55 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Deleted volume successfully. Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c8b2121-a997-46fe-955f-acd07566a581 tempest-AttachVolumeNegativeTest-1175679777 None] Lock "cinder-a94b645b-dfc9-46ec-9fd9-f1bec719b2dd-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:55 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e" returned: 0 in 0.470s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:55 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5 1073741824" returned: 0 in 0.673s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:55 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e Sep 04 06:02:55 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:55 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5 Sep 04 06:02:55 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:55 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1bc14e61-9b39-48b1-84a1-ff894b369e1e" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Lock "cinder-quobyte-1bc14e61-9b39-48b1-84a1-ff894b369e1e" released by "delete_volume" :: held 0.838s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:55 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Created reservations ['30abfca1-cd10-4958-9fad-13ac634316aa', '6ee917b1-9234-4ecd-91d0-7ddba25d40a0', 'd37128ba-2154-4815-9e2e-c73f6c87855c', '29cb0e63-004b-4876-a25a-f1f374bcab4b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa124be-9c35-4f46-b2f2-ffc89e6a7eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5433dd5-b8ea-489d-8453-c9bea9adb92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Volume volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5 (ce6c40e3-f884-4d14-ae71-a50d10875ca5): created successfully Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5433dd5-b8ea-489d-8453-c9bea9adb92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Flow 'volume_create_manager' (a6a9cd91-515f-4ddf-b4b8-6e944acf167c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-592adc13-37f6-42fb-ae8c-fa8f859600c5 tempest-VolumesMetadataTest-175977635 None] Created volume successfully. Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:56 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:56 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (5cccb5c4-ff16-464c-9405-fa6fad0c7ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (448344f5-7352-4e7c-8695-254d4aae3492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (448344f5-7352-4e7c-8695-254d4aae3492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-804514129',display_name='tempest-VolumesGetTest-Volume-774323363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c5c946-08f9-469a-92ae-9411c2f30e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:56Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f50b15-fd7f-45e4-aaa0-ba42f4a07c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f50b15-fd7f-45e4-aaa0-ba42f4a07c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629a999c-5ca2-4404-b026-359dd2af203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629a999c-5ca2-4404-b026-359dd2af203e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22c5c946-08f9-469a-92ae-9411c2f30e37', 'volume_name': 'volume-22c5c946-08f9-469a-92ae-9411c2f30e37', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1180e8c-bae6-4119-af24-e9b0635b61a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1180e8c-bae6-4119-af24-e9b0635b61a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afabe86-00d0-420d-a05a-641ed91412f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Volume 22c5c946-08f9-469a-92ae-9411c2f30e37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22c5c946-08f9-469a-92ae-9411c2f30e37', 'volume_size': 1} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:02:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-804514129',display_name='tempest-VolumesGetTest-Volume-774323363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c5c946-08f9-469a-92ae-9411c2f30e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6055bbec74ff798874a27ae95ff7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:56Z,use_quota=True,user_id='22820a4063424b31b8b2f5d78b958940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Creating volume 22c5c946-08f9-469a-92ae-9411c2f30e37 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:02:56 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-22c5c946-08f9-469a-92ae-9411c2f30e37 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:56 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-22c5c946-08f9-469a-92ae-9411c2f30e37 1073741824 Sep 04 06:02:56 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:56 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Deleted volume successfully. Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dca8e3cc-c738-45e8-b991-d705629be8fd tempest-AttachVolumeTestJSON-1586140776 None] Lock "cinder-1bc14e61-9b39-48b1-84a1-ff894b369e1e-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:56 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-22c5c946-08f9-469a-92ae-9411c2f30e37 1073741824" returned: 0 in 0.594s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-22c5c946-08f9-469a-92ae-9411c2f30e37 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:56 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-22c5c946-08f9-469a-92ae-9411c2f30e37 Sep 04 06:02:56 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:57 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-22c5c946-08f9-469a-92ae-9411c2f30e37" returned: 0 in 0.448s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afabe86-00d0-420d-a05a-641ed91412f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c5c946-08f9-469a-92ae-9411c2f30e37', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59f73e8-cedd-4240-94b7-701ecef6ec57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:02:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Volume volume-22c5c946-08f9-469a-92ae-9411c2f30e37 (22c5c946-08f9-469a-92ae-9411c2f30e37): created successfully Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59f73e8-cedd-4240-94b7-701ecef6ec57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Flow 'volume_create_manager' (5cccb5c4-ff16-464c-9405-fa6fad0c7ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:02:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f4cb89da-e483-433e-b61c-1472ccae0266 tempest-VolumesGetTest-340625814 None] Created volume successfully. Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Acquiring lock "cinder-ce6c40e3-f884-4d14-ae71-a50d10875ca5-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Lock "cinder-ce6c40e3-f884-4d14-ae71-a50d10875ca5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Acquiring lock "cinder-quobyte-ce6c40e3-f884-4d14-ae71-a50d10875ca5" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Lock "cinder-quobyte-ce6c40e3-f884-4d14-ae71-a50d10875ca5" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef64143a-a416-4475-9477-e340b92b0fbe]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:57 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5 Sep 04 06:02:57 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:58 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5" returned: 0 in 0.474s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:58 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5 Sep 04 06:02:58 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-22c5c946-08f9-469a-92ae-9411c2f30e37-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Lock "cinder-22c5c946-08f9-469a-92ae-9411c2f30e37-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-quobyte-22c5c946-08f9-469a-92ae-9411c2f30e37" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-22c5c946-08f9-469a-92ae-9411c2f30e37" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade87dd-cd4a-4ccb-91ae-e6b51f85c4b4]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-22c5c946-08f9-469a-92ae-9411c2f30e37 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:58 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ce6c40e3-f884-4d14-ae71-a50d10875ca5" returned: 0 in 0.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Lock "cinder-quobyte-ce6c40e3-f884-4d14-ae71-a50d10875ca5" released by "delete_volume" :: held 0.883s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:58 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-22c5c946-08f9-469a-92ae-9411c2f30e37 Sep 04 06:02:58 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Created reservations ['9ae433df-82cc-468a-b669-57936f3fde7a', 'fa50bb7c-dde5-4110-bd0a-a169cff17bb5', '0512c14d-f9dc-4c86-972e-039888224492', 'bd7c2f53-d410-49ed-b7c6-3f82731ed380'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:58 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:58 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:59 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-22c5c946-08f9-469a-92ae-9411c2f30e37" returned: 0 in 0.686s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-22c5c946-08f9-469a-92ae-9411c2f30e37 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:59 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-22c5c946-08f9-469a-92ae-9411c2f30e37 Sep 04 06:02:59 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:02:59 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.450s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:02:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Deleted volume successfully. Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-666ae6b5-95b3-4e5c-afba-43394050ef33 tempest-VolumesMetadataTest-175977635 None] Lock "cinder-ce6c40e3-f884-4d14-ae71-a50d10875ca5-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:59 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-22c5c946-08f9-469a-92ae-9411c2f30e37" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-22c5c946-08f9-469a-92ae-9411c2f30e37" released by "delete_volume" :: held 1.110s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Created reservations ['0c0cd5c5-05fb-455d-b421-9702014d466b', '4de6a382-4b9e-423e-a17a-c4252d62b1a9', '3b13dcaf-3bbb-47ec-b69b-6621488f5610', 'cf1343e2-074c-4ea6-9968-5693fcd96ecf'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:02:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:02:59 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:02:59 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:00 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Deleted volume successfully. Sep 04 06:03:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0f23694-5ee8-4493-a18c-259969bfbbe3 tempest-VolumesGetTest-340625814 None] Lock "cinder-22c5c946-08f9-469a-92ae-9411c2f30e37-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-79fd1c78-a6e6-42ed-b62c-5f11feb90858-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Lock "cinder-79fd1c78-a6e6-42ed-b62c-5f11feb90858-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Acquiring lock "cinder-quobyte-79fd1c78-a6e6-42ed-b62c-5f11feb90858" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-79fd1c78-a6e6-42ed-b62c-5f11feb90858" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dee6ad7-971c-4819-9e56-19b16e3bae5a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:01 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 Sep 04 06:03:01 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:01 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858" returned: 0 in 0.432s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:01 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858 Sep 04 06:03:01 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:01 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-79fd1c78-a6e6-42ed-b62c-5f11feb90858" returned: 0 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Lock "cinder-quobyte-79fd1c78-a6e6-42ed-b62c-5f11feb90858" released by "delete_volume" :: held 0.918s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:01 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Created reservations ['955ff66f-cd21-4fd5-a501-96c6ae6cc1d1', '95197685-d9c2-47b4-afb9-8d597474e985', '28edc008-5279-417d-baf4-fa0849056b1f', 'b507dc33-fee6-497c-a0db-d1a655254fa3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:02 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:03:02 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:02 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:02 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Deleted volume successfully. Sep 04 06:03:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf675ac3-3c15-480e-86d7-5ec9fa29cc34 tempest-VolumesGetTest-340625814 None] Lock "cinder-79fd1c78-a6e6-42ed-b62c-5f11feb90858-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Flow 'volume_create_manager' (7bc915bb-e83c-4532-a844-4ed86c827dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd0f765-e262-4778-b2c0-b1c3c4d9b424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd0f765-e262-4778-b2c0-b1c3c4d9b424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-26491171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16319d84-45b2-431b-aee7-0f59406c2f85,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b02eb5af26846b1a167f7162bcb4595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:07Z,use_quota=True,user_id='b0f8ac04922d43c1960946720bae00f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9827c39d-0a5d-4cd1-b26a-ec8fe33b4b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9827c39d-0a5d-4cd1-b26a-ec8fe33b4b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32400538-5bc8-485e-a5f7-6c3f17bac2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32400538-5bc8-485e-a5f7-6c3f17bac2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16319d84-45b2-431b-aee7-0f59406c2f85', 'volume_name': 'volume-16319d84-45b2-431b-aee7-0f59406c2f85', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d64d444-33cc-4fa3-96a5-cc4c39f0c455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d64d444-33cc-4fa3-96a5-cc4c39f0c455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd047e6b-680c-4118-9557-c7818308421e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Volume 16319d84-45b2-431b-aee7-0f59406c2f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16319d84-45b2-431b-aee7-0f59406c2f85', 'volume_size': 1} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-26491171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16319d84-45b2-431b-aee7-0f59406c2f85,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b02eb5af26846b1a167f7162bcb4595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:07Z,use_quota=True,user_id='b0f8ac04922d43c1960946720bae00f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Creating volume 16319d84-45b2-431b-aee7-0f59406c2f85 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:03:07 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-16319d84-45b2-431b-aee7-0f59406c2f85 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:07 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-16319d84-45b2-431b-aee7-0f59406c2f85 1073741824 Sep 04 06:03:07 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Flow 'volume_create_manager' (30f27be1-7ca2-49e9-8ff2-83bc309c4bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ac5693-1b82-47e4-bd7e-36161cbcdd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ac5693-1b82-47e4-bd7e-36161cbcdd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1115816634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc19cecd-feba-4d97-b583-0708ebf65a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dc9b3eeab44784ac83a4cb0e980730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:08Z,use_quota=True,user_id='b2ce1950f0d546339c4a710b7ccc7d45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b2ccaa-092c-45ed-8760-2caaea4edc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b2ccaa-092c-45ed-8760-2caaea4edc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601f7500-c17d-402f-aecf-462b5e51fa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601f7500-c17d-402f-aecf-462b5e51fa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc19cecd-feba-4d97-b583-0708ebf65a76', 'volume_name': 'volume-dc19cecd-feba-4d97-b583-0708ebf65a76', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc65f49-5e03-45f1-8225-268fd26992d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc65f49-5e03-45f1-8225-268fd26992d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef952c28-4b7d-4722-8804-e25fabda710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Volume dc19cecd-feba-4d97-b583-0708ebf65a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc19cecd-feba-4d97-b583-0708ebf65a76', 'volume_size': 1} Sep 04 06:03:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:08 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-16319d84-45b2-431b-aee7-0f59406c2f85 1073741824" returned: 0 in 0.651s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-16319d84-45b2-431b-aee7-0f59406c2f85 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:08 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-16319d84-45b2-431b-aee7-0f59406c2f85 Sep 04 06:03:08 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Flow 'volume_create_manager' (632287f8-978e-4d11-b2a5-fe76bd800839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8139bc50-f8de-4620-bd43-3369b0b752ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8139bc50-f8de-4620-bd43-3369b0b752ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-135476437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3df2a3-92f1-48ca-a6c8-a80992932e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e80e0e005ce408f90643fc2a65cb83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:08Z,use_quota=True,user_id='9f211d2f7e5649d79665015a58f03f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ae8ad6-9d69-4572-b8e0-1b41e89d4c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ae8ad6-9d69-4572-b8e0-1b41e89d4c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd80f47-3e97-42fa-befa-790f8f2761a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd80f47-3e97-42fa-befa-790f8f2761a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3df2a3-92f1-48ca-a6c8-a80992932e56', 'volume_name': 'volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3173565f-d539-4171-9e95-22733c9680e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3173565f-d539-4171-9e95-22733c9680e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:08 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560fa11b-641c-4e49-8cec-7b568abc9a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Volume 2e3df2a3-92f1-48ca-a6c8-a80992932e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56', 'volume_size': 1} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-16319d84-45b2-431b-aee7-0f59406c2f85" returned: 0 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.732s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1115816634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc19cecd-feba-4d97-b583-0708ebf65a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dc9b3eeab44784ac83a4cb0e980730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:08Z,use_quota=True,user_id='b2ce1950f0d546339c4a710b7ccc7d45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Creating volume dc19cecd-feba-4d97-b583-0708ebf65a76 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:03:08 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dc19cecd-feba-4d97-b583-0708ebf65a76 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:08 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dc19cecd-feba-4d97-b583-0708ebf65a76 1073741824 Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd047e6b-680c-4118-9557-c7818308421e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16319d84-45b2-431b-aee7-0f59406c2f85', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:08 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15430229-2c52-485b-8225-08163149fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Volume volume-16319d84-45b2-431b-aee7-0f59406c2f85 (16319d84-45b2-431b-aee7-0f59406c2f85): created successfully Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15430229-2c52-485b-8225-08163149fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Flow 'volume_create_manager' (7bc915bb-e83c-4532-a844-4ed86c827dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3fcc4548-d5ee-474e-812b-e141cde1185c tempest-VolumesListTestJSON-621763430 None] Created volume successfully. Sep 04 06:03:09 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dc19cecd-feba-4d97-b583-0708ebf65a76 1073741824" returned: 0 in 0.465s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dc19cecd-feba-4d97-b583-0708ebf65a76 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:09 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dc19cecd-feba-4d97-b583-0708ebf65a76 Sep 04 06:03:09 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:09 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dc19cecd-feba-4d97-b583-0708ebf65a76" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-135476437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3df2a3-92f1-48ca-a6c8-a80992932e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e80e0e005ce408f90643fc2a65cb83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:08Z,use_quota=True,user_id='9f211d2f7e5649d79665015a58f03f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Creating volume 2e3df2a3-92f1-48ca-a6c8-a80992932e56 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:03:09 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef952c28-4b7d-4722-8804-e25fabda710d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc19cecd-feba-4d97-b583-0708ebf65a76', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:09 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 1073741824 Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83d750c-58ad-4158-8ff7-5d5097c5f3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:09 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Volume volume-dc19cecd-feba-4d97-b583-0708ebf65a76 (dc19cecd-feba-4d97-b583-0708ebf65a76): created successfully Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83d750c-58ad-4158-8ff7-5d5097c5f3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Flow 'volume_create_manager' (30f27be1-7ca2-49e9-8ff2-83bc309c4bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-13a41b92-d022-49ab-a38c-1de8bdc26d46 tempest-VolumesTransfersV355Test-466734705 None] Created volume successfully. Sep 04 06:03:10 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 1073741824" returned: 0 in 0.644s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:10 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 Sep 04 06:03:10 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Flow 'volume_create_manager' (dd20a35b-9002-4b0e-9ecf-6382d3252682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ec4634-883e-4357-9608-a5cf2951d57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ec4634-883e-4357-9608-a5cf2951d57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-147563690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18de3903-8d92-4a78-bfd0-e907635e43c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b02eb5af26846b1a167f7162bcb4595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:10Z,use_quota=True,user_id='b0f8ac04922d43c1960946720bae00f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c21e0f-1eec-4be6-a7a0-55d9ccbaff22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c21e0f-1eec-4be6-a7a0-55d9ccbaff22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d667e6-4857-4175-bb00-0425659cd35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d667e6-4857-4175-bb00-0425659cd35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18de3903-8d92-4a78-bfd0-e907635e43c6', 'volume_name': 'volume-18de3903-8d92-4a78-bfd0-e907635e43c6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9184e9e8-cee1-4e4e-a249-acc9c38037ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9184e9e8-cee1-4e4e-a249-acc9c38037ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03aa9c9-bb87-46da-a8ee-80dc46205c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Volume 18de3903-8d92-4a78-bfd0-e907635e43c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18de3903-8d92-4a78-bfd0-e907635e43c6', 'volume_size': 1} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:10 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56" returned: 0 in 0.329s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.077s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-147563690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18de3903-8d92-4a78-bfd0-e907635e43c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b02eb5af26846b1a167f7162bcb4595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:10Z,use_quota=True,user_id='b0f8ac04922d43c1960946720bae00f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Creating volume 18de3903-8d92-4a78-bfd0-e907635e43c6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:03:10 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18de3903-8d92-4a78-bfd0-e907635e43c6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:10 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18de3903-8d92-4a78-bfd0-e907635e43c6 1073741824 Sep 04 06:03:10 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560fa11b-641c-4e49-8cec-7b568abc9a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3d1a86-7675-4baf-aea8-ac3d0a6112a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Volume volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 (2e3df2a3-92f1-48ca-a6c8-a80992932e56): created successfully Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3d1a86-7675-4baf-aea8-ac3d0a6112a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Flow 'volume_create_manager' (632287f8-978e-4d11-b2a5-fe76bd800839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-453f1770-53c2-4548-af67-c6782c9f0642 req-7949487c-a41d-42ba-bbc6-d805882d00c0 tempest-VolumesSnapshotsTestJSON-1466532472 None] Created volume successfully. Sep 04 06:03:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-55acf715-0b36-40c1-9d2b-dec798b20afc tempest-VolumesTransfersV355Test-1223907485 None] Transfer volume completed successfully. Sep 04 06:03:11 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18de3903-8d92-4a78-bfd0-e907635e43c6 1073741824" returned: 0 in 0.586s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18de3903-8d92-4a78-bfd0-e907635e43c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:11 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18de3903-8d92-4a78-bfd0-e907635e43c6 Sep 04 06:03:11 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:11 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18de3903-8d92-4a78-bfd0-e907635e43c6" returned: 0 in 0.310s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.283s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] Creating offline snapshot 85961700-c097-424b-8178-01c3fde7ef66 of volume 2e3df2a3-92f1-48ca-a6c8-a80992932e56 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03aa9c9-bb87-46da-a8ee-80dc46205c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18de3903-8d92-4a78-bfd0-e907635e43c6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd35a45-5238-4097-94f9-ee187be45fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fea6aa-0149-466b-9d78-932658943f6e]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Volume volume-18de3903-8d92-4a78-bfd0-e907635e43c6 (18de3903-8d92-4a78-bfd0-e907635e43c6): created successfully Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd35a45-5238-4097-94f9-ee187be45fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Flow 'volume_create_manager' (dd20a35b-9002-4b0e-9ecf-6382d3252682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4b4d63cf-8ae3-48f3-a3d2-1ac6b16e2c65 tempest-VolumesListTestJSON-621763430 None] Created volume successfully. Sep 04 06:03:11 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 Sep 04 06:03:11 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Acquiring lock "cinder-dc19cecd-feba-4d97-b583-0708ebf65a76-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Lock "cinder-dc19cecd-feba-4d97-b583-0708ebf65a76-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:11 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56" returned: 0 in 0.469s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:12 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 1G Sep 04 06:03:12 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Acquiring lock "cinder-quobyte-dc19cecd-feba-4d97-b583-0708ebf65a76" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Lock "cinder-quobyte-dc19cecd-feba-4d97-b583-0708ebf65a76" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[770461ea-f9d6-4b9d-8726-f6a60c05827d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dc19cecd-feba-4d97-b583-0708ebf65a76 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:12 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dc19cecd-feba-4d97-b583-0708ebf65a76 Sep 04 06:03:12 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:12 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dc19cecd-feba-4d97-b583-0708ebf65a76" returned: 0 in 0.500s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dc19cecd-feba-4d97-b583-0708ebf65a76 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:12 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 1G" returned: 0 in 0.639s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:12 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dc19cecd-feba-4d97-b583-0708ebf65a76 Sep 04 06:03:12 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:12 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 Sep 04 06:03:12 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:12 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dc19cecd-feba-4d97-b583-0708ebf65a76" returned: 0 in 0.372s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Lock "cinder-quobyte-dc19cecd-feba-4d97-b583-0708ebf65a76" released by "delete_volume" :: held 0.938s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Created reservations ['97e6e497-e225-48d9-9000-c968ed651bca', '44948951-375d-4031-ab39-7da9ca4075c1', 'fde306d3-9ce0-4947-8aad-4a1ea519d23b', '155dec65-88bd-4501-8d62-f28b00e5c66c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:13 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66" returned: 0 in 0.520s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:13 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 is being set with open permissions: ugo+rw Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:13 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 Sep 04 06:03:13 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:13 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:03:13 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Flow 'volume_create_manager' (4e062234-a3b7-4811-8e40-41e25843ca51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6afa3c0-2c1b-42c4-8e4c-bb4e007eff2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d3c75fd-dc44-4eca-ac51-047fba9611ed tempest-BackendsCapabilitiesAdminTestsJSON-30948095 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8068084716797, 'free_capacity_gb': 1773.8068084716797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87132) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6afa3c0-2c1b-42c4-8e4c-bb4e007eff2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-411987730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39ce891-869c-44f9-8e55-88d507ac55c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b02eb5af26846b1a167f7162bcb4595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:13Z,use_quota=True,user_id='b0f8ac04922d43c1960946720bae00f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dccb98-9a50-49f7-a698-ca73ae4f65b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dccb98-9a50-49f7-a698-ca73ae4f65b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ec5886-540c-4d40-a8a5-7a12e81087bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ec5886-540c-4d40-a8a5-7a12e81087bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd39ce891-869c-44f9-8e55-88d507ac55c0', 'volume_name': 'volume-d39ce891-869c-44f9-8e55-88d507ac55c0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155f869c-4285-4644-9bde-3f6d82f3cff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155f869c-4285-4644-9bde-3f6d82f3cff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7a317d-abc8-4ba3-a45c-49e4c640fe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Volume d39ce891-869c-44f9-8e55-88d507ac55c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d39ce891-869c-44f9-8e55-88d507ac55c0', 'volume_size': 1} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9daf17b1-2401-43f0-b303-340cc5cef777 tempest-BackendsCapabilitiesAdminTestsJSON-30948095 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8068084716797, 'free_capacity_gb': 1773.8068084716797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87132) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 06:03:13 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:13 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Deleted volume successfully. Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-44dd6e82-4f6d-448d-b187-d1d52a7b70da tempest-VolumesTransfersV355Test-1929342547 None] Lock "cinder-dc19cecd-feba-4d97-b583-0708ebf65a76-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:13 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.info Sep 04 06:03:13 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:13 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.info" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:13 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.info is being set with open permissions: ugo+rw Sep 04 06:03:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:13 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.info Sep 04 06:03:13 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:14 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.info" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.728s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-411987730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39ce891-869c-44f9-8e55-88d507ac55c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b02eb5af26846b1a167f7162bcb4595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:13Z,use_quota=True,user_id='b0f8ac04922d43c1960946720bae00f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Creating volume d39ce891-869c-44f9-8e55-88d507ac55c0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:03:14 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d39ce891-869c-44f9-8e55-88d507ac55c0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:14 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d39ce891-869c-44f9-8e55-88d507ac55c0 1073741824 Sep 04 06:03:14 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-551691d7-3a53-4cee-bdc1-39d714e95db4 req-5c672b59-e396-4520-b35e-34196dd1f33f tempest-VolumesSnapshotsTestJSON-1466532472 None] Create snapshot completed successfully Sep 04 06:03:14 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d39ce891-869c-44f9-8e55-88d507ac55c0 1073741824" returned: 0 in 0.584s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d39ce891-869c-44f9-8e55-88d507ac55c0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:14 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d39ce891-869c-44f9-8e55-88d507ac55c0 Sep 04 06:03:14 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Acquiring lock "cinder-85961700-c097-424b-8178-01c3fde7ef66-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Flow 'volume_create_manager' (d4e209d8-3e57-4bd9-b346-980aea6c4409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19b3943-6d27-4847-aea8-4ada070e4d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "cinder-85961700-c097-424b-8178-01c3fde7ef66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.118s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Acquiring lock "cinder-quobyte-2e3df2a3-92f1-48ca-a6c8-a80992932e56" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19b3943-6d27-4847-aea8-4ada070e4d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-757171175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3756d543-7134-4d43-8b60-a6a402bd52e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dc9b3eeab44784ac83a4cb0e980730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:15Z,use_quota=True,user_id='b2ce1950f0d546339c4a710b7ccc7d45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bce4804-23cd-4f73-9e54-9ae6107d6899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bce4804-23cd-4f73-9e54-9ae6107d6899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657ed5f8-b792-4e91-a673-1126d1211c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657ed5f8-b792-4e91-a673-1126d1211c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3756d543-7134-4d43-8b60-a6a402bd52e1', 'volume_name': 'volume-3756d543-7134-4d43-8b60-a6a402bd52e1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bdf8b3-5f2f-4cc6-9a16-f591d2cf6e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bdf8b3-5f2f-4cc6-9a16-f591d2cf6e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04c83eb-60e5-4654-bc43-7811345c1416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Volume 3756d543-7134-4d43-8b60-a6a402bd52e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3756d543-7134-4d43-8b60-a6a402bd52e1', 'volume_size': 1} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "cinder-quobyte-2e3df2a3-92f1-48ca-a6c8-a80992932e56" acquired by "delete_snapshot" :: waited 0.086s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Acquiring lock "cinder-quobyte-85961700-c097-424b-8178-01c3fde7ef66" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "cinder-quobyte-85961700-c097-424b-8178-01c3fde7ef66" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Deleting offline snapshot 85961700-c097-424b-8178-01c3fde7ef66 of volume 2e3df2a3-92f1-48ca-a6c8-a80992932e56 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] snapshot_file for this snap is: volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:03:15 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d39ce891-869c-44f9-8e55-88d507ac55c0" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-757171175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3756d543-7134-4d43-8b60-a6a402bd52e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dc9b3eeab44784ac83a4cb0e980730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:15Z,use_quota=True,user_id='b2ce1950f0d546339c4a710b7ccc7d45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Creating volume 3756d543-7134-4d43-8b60-a6a402bd52e1 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:03:15 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3756d543-7134-4d43-8b60-a6a402bd52e1 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[155e9dac-5338-4471-bca5-2b10c7b48ff9]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:15 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3756d543-7134-4d43-8b60-a6a402bd52e1 1073741824 Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7a317d-abc8-4ba3-a45c-49e4c640fe5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d39ce891-869c-44f9-8e55-88d507ac55c0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:15 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57be0b8a-01fc-4092-8c2d-990cabadc271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Volume volume-d39ce891-869c-44f9-8e55-88d507ac55c0 (d39ce891-869c-44f9-8e55-88d507ac55c0): created successfully Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57be0b8a-01fc-4092-8c2d-990cabadc271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Flow 'volume_create_manager' (4e062234-a3b7-4811-8e40-41e25843ca51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0f34674b-6af5-465c-aefb-8b8c513e2152 tempest-VolumesListTestJSON-621763430 None] Created volume successfully. Sep 04 06:03:15 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 Sep 04 06:03:15 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:15 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[692c86cd-df66-48de-900b-01dfe0c7432d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:15 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3756d543-7134-4d43-8b60-a6a402bd52e1 1073741824" returned: 0 in 0.625s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:15 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 Sep 04 06:03:15 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3756d543-7134-4d43-8b60-a6a402bd52e1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:15 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3756d543-7134-4d43-8b60-a6a402bd52e1 Sep 04 06:03:15 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:16 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3756d543-7134-4d43-8b60-a6a402bd52e1" returned: 0 in 0.290s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:03:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04c83eb-60e5-4654-bc43-7811345c1416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3756d543-7134-4d43-8b60-a6a402bd52e1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:16 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a001525d-0adb-47f9-b94e-8190ecfc1658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56" returned: 0 in 0.471s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Volume volume-3756d543-7134-4d43-8b60-a6a402bd52e1 (3756d543-7134-4d43-8b60-a6a402bd52e1): created successfully Sep 04 06:03:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a001525d-0adb-47f9-b94e-8190ecfc1658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:16 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 Sep 04 06:03:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Flow 'volume_create_manager' (d4e209d8-3e57-4bd9-b346-980aea6c4409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:16 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4aad11bb-9ac1-4bbd-a249-a7f9bb6605b3 tempest-VolumesTransfersV355Test-466734705 None] Created volume successfully. Sep 04 06:03:16 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66" returned: 0 in 0.451s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:16 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66 Sep 04 06:03:16 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:17 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56.85961700-c097-424b-8178-01c3fde7ef66" returned: 0 in 0.289s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "cinder-quobyte-85961700-c097-424b-8178-01c3fde7ef66" released by "_delete_snapshot" :: held 1.870s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "cinder-quobyte-2e3df2a3-92f1-48ca-a6c8-a80992932e56" released by "delete_snapshot" :: held 1.907s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG cinder.quota [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Created reservations ['f9369cbe-cefd-4932-81e0-b531bb00e8d1', '14690e48-20dd-4597-98b2-a9dace01c501', 'd8144d15-6b75-42c7-bdf0-c8e16fe894a6', '1fa0ee26-440e-4972-a00c-914386a9ff54'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Delete snapshot completed successfully. Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-a9b30893-b94b-4d87-8fc1-44a0e6030baa req-78488483-d1cc-4884-9760-2355c6133f27 tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "cinder-85961700-c097-424b-8178-01c3fde7ef66-delete_snapshot" released by "delete_snapshot" :: held 2.235s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Acquiring lock "cinder-3756d543-7134-4d43-8b60-a6a402bd52e1-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Lock "cinder-3756d543-7134-4d43-8b60-a6a402bd52e1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Acquiring lock "cinder-quobyte-3756d543-7134-4d43-8b60-a6a402bd52e1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Lock "cinder-quobyte-3756d543-7134-4d43-8b60-a6a402bd52e1" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[410959a0-7622-49d0-91a6-aa37123e765d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3756d543-7134-4d43-8b60-a6a402bd52e1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:17 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3756d543-7134-4d43-8b60-a6a402bd52e1 Sep 04 06:03:17 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:17 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3756d543-7134-4d43-8b60-a6a402bd52e1" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3756d543-7134-4d43-8b60-a6a402bd52e1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:17 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3756d543-7134-4d43-8b60-a6a402bd52e1 Sep 04 06:03:17 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:18 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3756d543-7134-4d43-8b60-a6a402bd52e1" returned: 0 in 0.266s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Lock "cinder-quobyte-3756d543-7134-4d43-8b60-a6a402bd52e1" released by "delete_volume" :: held 0.724s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Created reservations ['16a28cc7-0ef7-4511-8c58-de4c18b9ed85', 'f14b7e1a-4081-413c-b412-f8e17a83b0ab', '1050b6b4-d91d-4bce-83f3-9893b3394ce8', 'c6742fb0-eb38-415f-9e1b-8eeaa7d79e8b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Acquiring lock "cinder-2e3df2a3-92f1-48ca-a6c8-a80992932e56-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:18 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:03:18 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "cinder-2e3df2a3-92f1-48ca-a6c8-a80992932e56-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Acquiring lock "cinder-quobyte-2e3df2a3-92f1-48ca-a6c8-a80992932e56" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "cinder-quobyte-2e3df2a3-92f1-48ca-a6c8-a80992932e56" acquired by "delete_volume" :: waited 0.049s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[586b97fb-1268-4960-9298-ea7ea0df052d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:18 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 Sep 04 06:03:18 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:18 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.486s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Deleted volume successfully. Sep 04 06:03:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95057a53-85e7-487d-8aac-56d90be99fce tempest-VolumesTransfersV355Test-1929342547 None] Lock "cinder-3756d543-7134-4d43-8b60-a6a402bd52e1-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "cinder-d39ce891-869c-44f9-8e55-88d507ac55c0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Lock "cinder-d39ce891-869c-44f9-8e55-88d507ac55c0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:19 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "cinder-quobyte-d39ce891-869c-44f9-8e55-88d507ac55c0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56" returned: 0 in 0.553s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Lock "cinder-quobyte-d39ce891-869c-44f9-8e55-88d507ac55c0" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:19 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56 Sep 04 06:03:19 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf5840e-3366-43aa-9762-98bc63e01b0a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d39ce891-869c-44f9-8e55-88d507ac55c0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:19 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d39ce891-869c-44f9-8e55-88d507ac55c0 Sep 04 06:03:19 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:19 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2e3df2a3-92f1-48ca-a6c8-a80992932e56" returned: 0 in 0.318s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "cinder-quobyte-2e3df2a3-92f1-48ca-a6c8-a80992932e56" released by "delete_volume" :: held 0.995s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG cinder.quota [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Created reservations ['278da601-c280-4e5d-bc5e-c0721f28f752', 'c85b68c7-14bc-44ba-b69b-b2e3d9fd7705', 'f38703e8-a00e-400b-9f58-8626fbc99fa7', '64499853-345c-46fa-a474-aefd7731faa3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:19 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d39ce891-869c-44f9-8e55-88d507ac55c0" returned: 0 in 0.524s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d39ce891-869c-44f9-8e55-88d507ac55c0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:19 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d39ce891-869c-44f9-8e55-88d507ac55c0 Sep 04 06:03:19 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:19 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:03:19 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:20 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.319s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:20 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG cinder.manager [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d39ce891-869c-44f9-8e55-88d507ac55c0" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Deleted volume successfully. Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Lock "cinder-quobyte-d39ce891-869c-44f9-8e55-88d507ac55c0" released by "delete_volume" :: held 0.933s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-ff4f3ba6-25f8-41a4-8234-b68967244f0e req-48550d93-80fd-45bc-a4fb-494393d9e22e tempest-VolumesSnapshotsTestJSON-1466532472 None] Lock "cinder-2e3df2a3-92f1-48ca-a6c8-a80992932e56-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Created reservations ['ea059ffd-ac50-4928-aa9e-e34eaf2f583d', '74145515-bf45-45dc-9bdb-b10ffe8ad30d', '192fa8b3-a3e7-4451-9e5b-9714930b7718', '73a00b48-ee2c-489b-8b86-c624beda4b90'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:20 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:03:20 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:20 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Deleted volume successfully. Sep 04 06:03:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a2a1cc2b-94b1-41a9-9914-f9a108a0d363 tempest-VolumesListTestJSON-621763430 None] Lock "cinder-d39ce891-869c-44f9-8e55-88d507ac55c0-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "cinder-18de3903-8d92-4a78-bfd0-e907635e43c6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Lock "cinder-18de3903-8d92-4a78-bfd0-e907635e43c6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "cinder-quobyte-18de3903-8d92-4a78-bfd0-e907635e43c6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Lock "cinder-quobyte-18de3903-8d92-4a78-bfd0-e907635e43c6" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76ba7e9-a683-40dc-9160-18131f83b9ac]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18de3903-8d92-4a78-bfd0-e907635e43c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:21 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18de3903-8d92-4a78-bfd0-e907635e43c6 Sep 04 06:03:21 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:22 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18de3903-8d92-4a78-bfd0-e907635e43c6" returned: 0 in 0.527s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18de3903-8d92-4a78-bfd0-e907635e43c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:22 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18de3903-8d92-4a78-bfd0-e907635e43c6 Sep 04 06:03:22 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:22 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18de3903-8d92-4a78-bfd0-e907635e43c6" returned: 0 in 0.289s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Lock "cinder-quobyte-18de3903-8d92-4a78-bfd0-e907635e43c6" released by "delete_volume" :: held 0.883s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Created reservations ['5b001d15-fab4-4f64-bbfd-8f61ac6e0f3c', '5e0421f1-ebcc-43a1-acca-8a626e065b44', 'd0ab78eb-e82b-47d2-82b5-8df07f5d81e7', 'c12bc79c-8f39-4f78-b60d-f92ecb566660'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:22 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:03:22 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "cinder-16319d84-45b2-431b-aee7-0f59406c2f85-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Lock "cinder-16319d84-45b2-431b-aee7-0f59406c2f85-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "cinder-quobyte-16319d84-45b2-431b-aee7-0f59406c2f85" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Lock "cinder-quobyte-16319d84-45b2-431b-aee7-0f59406c2f85" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6a54c1-2316-43ae-be28-0d00a079de95]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-16319d84-45b2-431b-aee7-0f59406c2f85 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:23 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.388s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:23 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Deleted volume successfully. Sep 04 06:03:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-afdc9732-23e1-42a7-a7f2-d95c060c1699 tempest-VolumesListTestJSON-621763430 None] Lock "cinder-18de3903-8d92-4a78-bfd0-e907635e43c6-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:23 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-16319d84-45b2-431b-aee7-0f59406c2f85 Sep 04 06:03:23 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:23 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-16319d84-45b2-431b-aee7-0f59406c2f85" returned: 0 in 0.540s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-16319d84-45b2-431b-aee7-0f59406c2f85 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:23 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-16319d84-45b2-431b-aee7-0f59406c2f85 Sep 04 06:03:23 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:23 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-16319d84-45b2-431b-aee7-0f59406c2f85" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Lock "cinder-quobyte-16319d84-45b2-431b-aee7-0f59406c2f85" released by "delete_volume" :: held 0.952s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:24 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Created reservations ['a2565489-3915-4685-aafa-6df1c3df5765', 'd5a3526c-2219-4b6f-a265-1859bb38f649', '2dec6f04-0486-4d5d-84f2-26f52ac53968', '2e4e2f9e-37e3-48d8-bae3-1f60c4c723b9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:24 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:03:24 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:24 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.420s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:24 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Deleted volume successfully. Sep 04 06:03:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b0ef390-b8a5-4e72-a6ed-6c741e965892 tempest-VolumesListTestJSON-621763430 None] Lock "cinder-16319d84-45b2-431b-aee7-0f59406c2f85-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:03:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:25 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:03:25 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:25 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:03:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:03:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Flow 'volume_create_manager' (a82775a2-5442-4d73-8085-f36ac1bc1a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41e5072-7ea4-4008-ba07-3c6b60db3b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41e5072-7ea4-4008-ba07-3c6b60db3b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1268354092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ab1d08-dcfa-4211-b392-55687a04e50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a402f755144469973cf15c00c2283b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:28Z,use_quota=True,user_id='a001de2463da4d6699fcc206838d5d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c9af1b-b845-42b0-93e2-03ed7d0d8867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c9af1b-b845-42b0-93e2-03ed7d0d8867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24a1b77-ca7d-47c4-b31d-5c8392ae7e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24a1b77-ca7d-47c4-b31d-5c8392ae7e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05ab1d08-dcfa-4211-b392-55687a04e50c', 'volume_name': 'volume-05ab1d08-dcfa-4211-b392-55687a04e50c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0f4b73-fb84-4333-bd5c-83f620d55d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0f4b73-fb84-4333-bd5c-83f620d55d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dccb9f90-171a-40fd-baf5-23905f201162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:27 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Volume 05ab1d08-dcfa-4211-b392-55687a04e50c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05ab1d08-dcfa-4211-b392-55687a04e50c', 'volume_size': 1} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1268354092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ab1d08-dcfa-4211-b392-55687a04e50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a402f755144469973cf15c00c2283b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:28Z,use_quota=True,user_id='a001de2463da4d6699fcc206838d5d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Creating volume 05ab1d08-dcfa-4211-b392-55687a04e50c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:03:27 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:03:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:28 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c 1073741824 Sep 04 06:03:28 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Flow 'volume_create_manager' (c79a535d-75f4-471a-8f78-eee8177443d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:28 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1795b4-985b-4493-9507-c7a43e179c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c 1073741824" returned: 0 in 0.647s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1795b4-985b-4493-9507-c7a43e179c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2048259466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251def6e-9a66-4db8-8992-4d1c5b784411,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d34dbb8a129456eb2fb5e1d3778fd44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:28Z,use_quota=True,user_id='aca0ab985cd24f7e82e7e5c52dcf118a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc0e937-ff48-4005-91a9-42ce95e1e446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc0e937-ff48-4005-91a9-42ce95e1e446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c89afb3-3ff5-4ba5-baa5-c495f336719b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c89afb3-3ff5-4ba5-baa5-c495f336719b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251def6e-9a66-4db8-8992-4d1c5b784411', 'volume_name': 'volume-251def6e-9a66-4db8-8992-4d1c5b784411', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315f37a5-5019-4bb3-bf19-7380a8f21038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315f37a5-5019-4bb3-bf19-7380a8f21038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110ab770-8060-446c-a03a-f75a6b926f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Volume 251def6e-9a66-4db8-8992-4d1c5b784411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251def6e-9a66-4db8-8992-4d1c5b784411', 'volume_size': 1} Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:28 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c Sep 04 06:03:28 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:29 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c" returned: 0 in 0.318s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2048259466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251def6e-9a66-4db8-8992-4d1c5b784411,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d34dbb8a129456eb2fb5e1d3778fd44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:28Z,use_quota=True,user_id='aca0ab985cd24f7e82e7e5c52dcf118a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Creating volume 251def6e-9a66-4db8-8992-4d1c5b784411 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:03:29 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-251def6e-9a66-4db8-8992-4d1c5b784411 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dccb9f90-171a-40fd-baf5-23905f201162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ab1d08-dcfa-4211-b392-55687a04e50c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:29 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-251def6e-9a66-4db8-8992-4d1c5b784411 1073741824 Sep 04 06:03:29 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8f3cc6-c2f3-457b-a0da-dc24b0f81dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Volume volume-05ab1d08-dcfa-4211-b392-55687a04e50c (05ab1d08-dcfa-4211-b392-55687a04e50c): created successfully Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8f3cc6-c2f3-457b-a0da-dc24b0f81dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Flow 'volume_create_manager' (a82775a2-5442-4d73-8085-f36ac1bc1a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-54ceb47d-6d9f-4b2d-9f39-4f80b4cba2e4 tempest-VolumesCloneTest-664876395 None] Created volume successfully. Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Flow 'volume_create_manager' (5145afce-e9cf-494f-90e2-815b700ce3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3772cdb5-0c08-4e5c-b380-6de1cf4c5cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3772cdb5-0c08-4e5c-b380-6de1cf4c5cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-759707607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b372f73-7b64-4fe8-b890-fe5d659f8f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e455ae121ef4404ae767896ae3b412e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:29Z,use_quota=True,user_id='38989e2385b1489b8e8a2f3c09e15266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1e0955-b2ad-4258-bdb7-0e5ce4938209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1e0955-b2ad-4258-bdb7-0e5ce4938209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206a4281-d992-4856-8664-49c75d8ac7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206a4281-d992-4856-8664-49c75d8ac7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b372f73-7b64-4fe8-b890-fe5d659f8f5f', 'volume_name': 'volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85afa490-f5a8-48bd-98ef-f19f6f3ba13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85afa490-f5a8-48bd-98ef-f19f6f3ba13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09836800-c6c0-439d-aec1-5999c426641f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Volume 7b372f73-7b64-4fe8-b890-fe5d659f8f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f', 'volume_size': 1} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:29 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-251def6e-9a66-4db8-8992-4d1c5b784411 1073741824" returned: 0 in 0.473s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-251def6e-9a66-4db8-8992-4d1c5b784411 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:29 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-251def6e-9a66-4db8-8992-4d1c5b784411 Sep 04 06:03:29 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:29 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-251def6e-9a66-4db8-8992-4d1c5b784411" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.574s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-759707607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b372f73-7b64-4fe8-b890-fe5d659f8f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e455ae121ef4404ae767896ae3b412e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:29Z,use_quota=True,user_id='38989e2385b1489b8e8a2f3c09e15266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Creating volume 7b372f73-7b64-4fe8-b890-fe5d659f8f5f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:03:29 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110ab770-8060-446c-a03a-f75a6b926f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251def6e-9a66-4db8-8992-4d1c5b784411', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a6ac43-378f-4851-bac4-43badff36e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:29 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f 1073741824 Sep 04 06:03:29 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Volume volume-251def6e-9a66-4db8-8992-4d1c5b784411 (251def6e-9a66-4db8-8992-4d1c5b784411): created successfully Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a6ac43-378f-4851-bac4-43badff36e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Flow 'volume_create_manager' (c79a535d-75f4-471a-8f78-eee8177443d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-2dd32307-90ad-40a0-9e07-794a9e128a93 req-2544d3a0-838f-4c76-a8c3-65f717ae387e tempest-VolumesGetTestJSON-1429209295 None] Created volume successfully. Sep 04 06:03:30 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f 1073741824" returned: 0 in 0.549s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:30 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f Sep 04 06:03:30 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Flow 'volume_create_manager' (d7d941a6-0942-421c-a98c-10697f041aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17dc3260-46a9-41c3-b81a-d2c7165ad0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17dc3260-46a9-41c3-b81a-d2c7165ad0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-445898573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17cb53b-a587-4d9f-bcc8-b7f57f20d27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a402f755144469973cf15c00c2283b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=05ab1d08-dcfa-4211-b392-55687a04e50c,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:31Z,use_quota=True,user_id='a001de2463da4d6699fcc206838d5d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61025f84-eefd-4ecb-b22f-049ac66de754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61025f84-eefd-4ecb-b22f-049ac66de754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12776f55-e4f8-4091-9c97-ff1af5a851de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12776f55-e4f8-4091-9c97-ff1af5a851de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e17cb53b-a587-4d9f-bcc8-b7f57f20d27e', 'volume_name': 'volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e', 'volume_size': 2, 'source_volid': '05ab1d08-dcfa-4211-b392-55687a04e50c', 'source_volstatus': 'available'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8251a01-0066-45e8-bfed-15f002772947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8251a01-0066-45e8-bfed-15f002772947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4632323d-45dd-4a31-972b-f971cc416619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Volume e17cb53b-a587-4d9f-bcc8-b7f57f20d27e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e', 'volume_size': 2, 'source_volid': '05ab1d08-dcfa-4211-b392-55687a04e50c', 'source_volstatus': 'available'} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:30 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:30 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Cloning volume 05ab1d08-dcfa-4211-b392-55687a04e50c to volume e17cb53b-a587-4d9f-bcc8-b7f57f20d27e Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09836800-c6c0-439d-aec1-5999c426641f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06571c1-7f45-44da-80eb-fad62067bffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Volume volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f (7b372f73-7b64-4fe8-b890-fe5d659f8f5f): created successfully Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06571c1-7f45-44da-80eb-fad62067bffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Flow 'volume_create_manager' (5145afce-e9cf-494f-90e2-815b700ce3d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Creating offline snapshot 40bdb1e7-db63-4c58-a2b2-3d1087578c41 of volume 05ab1d08-dcfa-4211-b392-55687a04e50c {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:03:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5039470b-7bbc-4bc1-bb5c-3eed46a112fa tempest-VolumesNegativeTest-1623273783 None] Created volume successfully. Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e579108-92f8-4028-8624-38a30d0c37ae]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:30 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c Sep 04 06:03:30 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:31 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:31 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 1G Sep 04 06:03:31 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Acquiring lock "cinder-251def6e-9a66-4db8-8992-4d1c5b784411-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Lock "cinder-251def6e-9a66-4db8-8992-4d1c5b784411-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Acquiring lock "cinder-quobyte-251def6e-9a66-4db8-8992-4d1c5b784411" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Lock "cinder-quobyte-251def6e-9a66-4db8-8992-4d1c5b784411" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[887662c3-8801-4124-be85-da422f230b4d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-251def6e-9a66-4db8-8992-4d1c5b784411 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:31 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 1G" returned: 0 in 0.576s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05ab1d08-dcfa-4211-b392-55687a04e50c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:31 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05ab1d08-dcfa-4211-b392-55687a04e50c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 Sep 04 06:03:31 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:31 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-251def6e-9a66-4db8-8992-4d1c5b784411 Sep 04 06:03:31 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:32 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:32 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-251def6e-9a66-4db8-8992-4d1c5b784411" returned: 0 in 0.448s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-251def6e-9a66-4db8-8992-4d1c5b784411 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05ab1d08-dcfa-4211-b392-55687a04e50c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:32 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 is being set with open permissions: ugo+rw Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:32 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-251def6e-9a66-4db8-8992-4d1c5b784411 Sep 04 06:03:32 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:32 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 Sep 04 06:03:32 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:32 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41" returned: 0 in 0.314s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:32 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-251def6e-9a66-4db8-8992-4d1c5b784411" returned: 0 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Lock "cinder-quobyte-251def6e-9a66-4db8-8992-4d1c5b784411" released by "delete_volume" :: held 0.859s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:32 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.info Sep 04 06:03:32 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG cinder.quota [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Created reservations ['fdda25fe-6558-4d1e-9554-c395bf61b8a5', 'a242c427-dd28-4609-80dd-e307eee08464', 'd5ce1927-2977-4ddb-979e-2ab20521f8bb', '8e3fb095-174a-421f-be76-ed692ee662a2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:32 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:03:32 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:32 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.info" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:32 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.info is being set with open permissions: ugo+rw Sep 04 06:03:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:32 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.info Sep 04 06:03:32 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:33 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.376s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG cinder.manager [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Deleted volume successfully. Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-846faf63-999c-4bc8-b419-e69a92092ca4 req-14869a34-6491-4933-b45b-627b1c20c731 tempest-VolumesGetTestJSON-1429209295 None] Lock "cinder-251def6e-9a66-4db8-8992-4d1c5b784411-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:33 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.info" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Acquiring lock "cinder-quobyte-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Lock "cinder-quobyte-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] snapshot: 40bdb1e7-db63-4c58-a2b2-3d1087578c41, volume: e17cb53b-a587-4d9f-bcc8-b7f57f20d27e, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[828da8c6-79ac-4efc-a861-b3abb9110f7e]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:33 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 Sep 04 06:03:33 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:33 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41" returned: 0 in 0.565s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05ab1d08-dcfa-4211-b392-55687a04e50c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:03:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca23f18-cb90-49d8-854f-c0033c493607]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:34 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c Sep 04 06:03:34 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:34 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c" returned: 0 in 0.573s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] will copy from snapshot at /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 06:03:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 06:03:34 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Path /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 06:03:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:34 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e Sep 04 06:03:34 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=221,cinder:SELECT=172,cinder:INSERT=72,cinder:DELETE=17 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:03:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=227,cinder:DELETE=21,cinder:INSERT=58,cinder:SELECT=180 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:03:40 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Flow 'volume_create_manager' (e91336a4-e53f-4051-b215-966bc66c8f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd93d59-5cdf-456e-a1a9-1e005231928a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd93d59-5cdf-456e-a1a9-1e005231928a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2100603065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0137a333-8a34-4c62-9899-ac390a49f065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6462bad9eb340b495b970efefefd1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:41Z,use_quota=True,user_id='8bbe63fc989e4167b7ad00432a5832a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14a0a3e-deea-4dcb-9543-c160857f2b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14a0a3e-deea-4dcb-9543-c160857f2b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f088fa3-1479-4591-9f00-c8e9d2cde02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f088fa3-1479-4591-9f00-c8e9d2cde02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0137a333-8a34-4c62-9899-ac390a49f065', 'volume_name': 'volume-0137a333-8a34-4c62-9899-ac390a49f065', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16782330-d4f4-45bf-b7fa-cda4b6f4b277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16782330-d4f4-45bf-b7fa-cda4b6f4b277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89522d6-d276-48c5-b56d-8f7c5dc77335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Volume 0137a333-8a34-4c62-9899-ac390a49f065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0137a333-8a34-4c62-9899-ac390a49f065', 'volume_size': 1} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:41 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e" returned: 0 in 6.575s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:03:41 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Converted 1024.00 MB image at 155.68 MB/s Sep 04 06:03:41 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e is being set with open permissions: ugo+rw Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:41 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e Sep 04 06:03:41 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:41 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e" returned: 0 in 0.289s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Lock "cinder-quobyte-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e" released by "_copy_volume_from_snapshot" :: held 8.115s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Acquiring lock "cinder-quobyte-40bdb1e7-db63-4c58-a2b2-3d1087578c41" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Lock "cinder-quobyte-40bdb1e7-db63-4c58-a2b2-3d1087578c41" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Deleting offline snapshot 40bdb1e7-db63-4c58-a2b2-3d1087578c41 of volume 05ab1d08-dcfa-4211-b392-55687a04e50c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] snapshot_file for this snap is: volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b74986c-6241-4852-bae7-c5086c14c642]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:41 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 Sep 04 06:03:41 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:42 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41" returned: 0 in 0.761s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05ab1d08-dcfa-4211-b392-55687a04e50c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:03:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a90413-9c61-4772-8555-4815a54fc1df]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:42 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c Sep 04 06:03:42 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:43 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c" returned: 0 in 0.890s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:43 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 Sep 04 06:03:43 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:44 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41" returned: 0 in 0.730s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:44 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41 Sep 04 06:03:44 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:44 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c.40bdb1e7-db63-4c58-a2b2-3d1087578c41" returned: 0 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Lock "cinder-quobyte-40bdb1e7-db63-4c58-a2b2-3d1087578c41" released by "_delete_snapshot" :: held 2.871s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.677s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.338s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2100603065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0137a333-8a34-4c62-9899-ac390a49f065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6462bad9eb340b495b970efefefd1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:41Z,use_quota=True,user_id='8bbe63fc989e4167b7ad00432a5832a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Creating volume 0137a333-8a34-4c62-9899-ac390a49f065 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:03:44 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0137a333-8a34-4c62-9899-ac390a49f065 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4632323d-45dd-4a31-972b-f971cc416619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e', 'volume_size': 2, 'source_volid': '05ab1d08-dcfa-4211-b392-55687a04e50c', 'source_volstatus': 'available'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:44 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0137a333-8a34-4c62-9899-ac390a49f065 1073741824 Sep 04 06:03:44 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831df55b-11e6-464a-8f97-242f77383571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Volume volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e (e17cb53b-a587-4d9f-bcc8-b7f57f20d27e): created successfully Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831df55b-11e6-464a-8f97-242f77383571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Flow 'volume_create_manager' (d7d941a6-0942-421c-a98c-10697f041aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c79cb21f-deea-4768-b27b-b7c8ec9ea4d8 tempest-VolumesCloneTest-664876395 None] Created volume successfully. Sep 04 06:03:45 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0137a333-8a34-4c62-9899-ac390a49f065 1073741824" returned: 0 in 0.634s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0137a333-8a34-4c62-9899-ac390a49f065 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:45 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0137a333-8a34-4c62-9899-ac390a49f065 Sep 04 06:03:45 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:45 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0137a333-8a34-4c62-9899-ac390a49f065" returned: 0 in 0.479s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89522d6-d276-48c5-b56d-8f7c5dc77335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0137a333-8a34-4c62-9899-ac390a49f065', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee17761a-ed6f-4088-bfae-aaee7eff1fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Volume volume-0137a333-8a34-4c62-9899-ac390a49f065 (0137a333-8a34-4c62-9899-ac390a49f065): created successfully Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee17761a-ed6f-4088-bfae-aaee7eff1fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Flow 'volume_create_manager' (e91336a4-e53f-4051-b215-966bc66c8f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Acquiring lock "cinder-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4c229449-5a3a-4337-b250-ced64d1c3df7 tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Created volume successfully. Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Lock "cinder-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Acquiring lock "cinder-quobyte-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Lock "cinder-quobyte-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1d1a4d-b986-4270-8f87-1f2fbbc746d2]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:46 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e Sep 04 06:03:46 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:46 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e" returned: 0 in 0.623s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:46 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e Sep 04 06:03:46 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:47 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e" returned: 0 in 0.497s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Lock "cinder-quobyte-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e" released by "delete_volume" :: held 1.198s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:47 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Created reservations ['0e90ab55-585a-4b90-9ab8-06186e4f4c02', '75164307-87f7-4cde-b1a7-d9ed65af4949', 'da0947e0-9e8d-463a-939b-3aa01ccb44e3', '80cc250c-b489-4ebc-83bd-d84eb8a66caa'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:47 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:03:47 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:47 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Deleted volume successfully. Sep 04 06:03:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f708efcb-d56b-4e0e-b0d3-1441301918f0 tempest-VolumesCloneTest-664876395 None] Lock "cinder-e17cb53b-a587-4d9f-bcc8-b7f57f20d27e-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Acquiring lock "cinder-0137a333-8a34-4c62-9899-ac390a49f065-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Lock "cinder-0137a333-8a34-4c62-9899-ac390a49f065-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Acquiring lock "cinder-quobyte-0137a333-8a34-4c62-9899-ac390a49f065" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Lock "cinder-quobyte-0137a333-8a34-4c62-9899-ac390a49f065" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d55530-559a-4de3-8991-c62a8a5b5874]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0137a333-8a34-4c62-9899-ac390a49f065 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Acquiring lock "cinder-05ab1d08-dcfa-4211-b392-55687a04e50c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Lock "cinder-05ab1d08-dcfa-4211-b392-55687a04e50c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:48 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0137a333-8a34-4c62-9899-ac390a49f065 Sep 04 06:03:48 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Acquiring lock "cinder-quobyte-05ab1d08-dcfa-4211-b392-55687a04e50c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Lock "cinder-quobyte-05ab1d08-dcfa-4211-b392-55687a04e50c" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cbe3c8-85d0-4173-9299-922015bc7a2f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:48 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c Sep 04 06:03:48 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:48 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0137a333-8a34-4c62-9899-ac390a49f065" returned: 0 in 0.598s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0137a333-8a34-4c62-9899-ac390a49f065 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:48 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0137a333-8a34-4c62-9899-ac390a49f065 Sep 04 06:03:48 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:49 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c" returned: 0 in 0.618s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:49 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c Sep 04 06:03:49 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:49 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0137a333-8a34-4c62-9899-ac390a49f065" returned: 0 in 0.430s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Lock "cinder-quobyte-0137a333-8a34-4c62-9899-ac390a49f065" released by "delete_volume" :: held 1.094s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Created reservations ['7ff4c624-bacf-4eee-80a9-22d45e49c4e9', '69d1ffd6-17fd-48d5-95b8-588d575af68a', '43d0758c-7c8e-4ce0-92f1-db0addaca2f5', '583ad1d5-bee4-4d2d-87ff-d8831d8d4bb7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:49 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-05ab1d08-dcfa-4211-b392-55687a04e50c" returned: 0 in 0.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Lock "cinder-quobyte-05ab1d08-dcfa-4211-b392-55687a04e50c" released by "delete_volume" :: held 1.049s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:49 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:03:49 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Created reservations ['cd19d1f3-e65f-4be6-8efc-8b675a91a29a', '5e7f657e-b0aa-4632-9ef9-c648d5c02e9a', '224eaa63-4f3a-4c5d-b280-2372cad7f5df', '15a80db9-d00d-48e3-b08c-c90d817e8448'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:49 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:03:49 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:49 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Deleted volume successfully. Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-38789223-6927-4b67-bcc3-9fce921f5cbc tempest-VolumeQuotasNegativeTestJSON-1270966422 None] Lock "cinder-0137a333-8a34-4c62-9899-ac390a49f065-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:49 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:03:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Deleted volume successfully. Sep 04 06:03:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86b73943-49d9-4c62-9bba-8adbefb03860 tempest-VolumesCloneTest-664876395 None] Lock "cinder-05ab1d08-dcfa-4211-b392-55687a04e50c-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Flow 'volume_create_manager' (ead2b9b4-897c-4afe-95a0-9a737bfe9175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3dff52-d934-4c64-b683-115dc51a5a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3dff52-d934-4c64-b683-115dc51a5a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-883985575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8adc1e0d-5671-453b-adc1-08c655b0a6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='575ce5e0e8d049249a114392abe3e4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:51Z,use_quota=True,user_id='93f1cbd2ee8e494ba15fe16b2831add0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ad98ca-7dd9-400b-ae77-87f2909f03db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ad98ca-7dd9-400b-ae77-87f2909f03db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa9fd93-0f00-48fb-be52-a1cda5cfc41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa9fd93-0f00-48fb-be52-a1cda5cfc41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8adc1e0d-5671-453b-adc1-08c655b0a6db', 'volume_name': 'volume-8adc1e0d-5671-453b-adc1-08c655b0a6db', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1323cdc4-d5ea-4640-9e42-36c5e3169c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1323cdc4-d5ea-4640-9e42-36c5e3169c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb14e683-b003-4d15-8792-bf107164432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:50 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Volume 8adc1e0d-5671-453b-adc1-08c655b0a6db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8adc1e0d-5671-453b-adc1-08c655b0a6db', 'volume_size': 1} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-883985575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8adc1e0d-5671-453b-adc1-08c655b0a6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='575ce5e0e8d049249a114392abe3e4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:51Z,use_quota=True,user_id='93f1cbd2ee8e494ba15fe16b2831add0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Creating volume 8adc1e0d-5671-453b-adc1-08c655b0a6db {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:03:50 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:03:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:50 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db 1073741824 Sep 04 06:03:50 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:51 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db 1073741824" returned: 0 in 0.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:51 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db Sep 04 06:03:51 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:51 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db" returned: 0 in 0.308s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:03:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb14e683-b003-4d15-8792-bf107164432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8adc1e0d-5671-453b-adc1-08c655b0a6db', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f697142-d941-4ac5-ae0a-5326d4017daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Volume volume-8adc1e0d-5671-453b-adc1-08c655b0a6db (8adc1e0d-5671-453b-adc1-08c655b0a6db): created successfully Sep 04 06:03:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f697142-d941-4ac5-ae0a-5326d4017daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Flow 'volume_create_manager' (ead2b9b4-897c-4afe-95a0-9a737bfe9175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c8200901-c9e4-43c4-b1ee-ac0dc4e21e75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Created volume successfully. Sep 04 06:03:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Creating offline snapshot d79f39b6-bda9-4a94-865a-74a8390f866a of volume 8adc1e0d-5671-453b-adc1-08c655b0a6db {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:03:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd792aae-137d-4a10-9488-862e967956d4]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:53 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db Sep 04 06:03:53 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:53 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db" returned: 0 in 0.585s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:53 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a 1G Sep 04 06:03:53 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:54 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a 1G" returned: 0 in 0.629s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8adc1e0d-5671-453b-adc1-08c655b0a6db -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:54 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8adc1e0d-5671-453b-adc1-08c655b0a6db -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a Sep 04 06:03:54 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:54 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8adc1e0d-5671-453b-adc1-08c655b0a6db -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a" returned: 0 in 0.432s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:54 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a is being set with open permissions: ugo+rw Sep 04 06:03:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:54 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a Sep 04 06:03:54 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:55 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:55 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.info Sep 04 06:03:55 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:55 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.info" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:55 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.info is being set with open permissions: ugo+rw Sep 04 06:03:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:55 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.info Sep 04 06:03:55 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:55 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.info" returned: 0 in 0.367s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7bfb852f-0f09-46e3-9735-830c9511c5ca tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Create snapshot completed successfully Sep 04 06:03:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Acquiring lock "cinder-d79f39b6-bda9-4a94-865a-74a8390f866a-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "cinder-d79f39b6-bda9-4a94-865a-74a8390f866a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Acquiring lock "cinder-quobyte-8adc1e0d-5671-453b-adc1-08c655b0a6db" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "cinder-quobyte-8adc1e0d-5671-453b-adc1-08c655b0a6db" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Acquiring lock "cinder-quobyte-d79f39b6-bda9-4a94-865a-74a8390f866a" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "cinder-quobyte-d79f39b6-bda9-4a94-865a-74a8390f866a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Deleting offline snapshot d79f39b6-bda9-4a94-865a-74a8390f866a of volume 8adc1e0d-5671-453b-adc1-08c655b0a6db {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:03:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] snapshot_file for this snap is: volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:03:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa85bf4-b9ac-471b-b049-db8da8f3062f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:57 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a Sep 04 06:03:57 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:57 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a" returned: 0 in 0.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8adc1e0d-5671-453b-adc1-08c655b0a6db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:03:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cb5839-7ea8-46af-bb01-951d3ef38fcd]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:57 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db Sep 04 06:03:57 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:58 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db" returned: 0 in 0.495s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:58 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a Sep 04 06:03:58 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:58 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a" returned: 0 in 0.410s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:58 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a Sep 04 06:03:58 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:58 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db.d79f39b6-bda9-4a94-865a-74a8390f866a" returned: 0 in 0.304s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "cinder-quobyte-d79f39b6-bda9-4a94-865a-74a8390f866a" released by "_delete_snapshot" :: held 1.799s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "cinder-quobyte-8adc1e0d-5671-453b-adc1-08c655b0a6db" released by "delete_snapshot" :: held 1.842s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Created reservations ['385a5968-9ace-4474-8f26-9ccaeeda0be6', 'c4431466-8bfd-4e31-a372-8164a44aa5aa', '07c1a2d6-e3f2-42f7-a72e-d0c5638cc8db', '15af9b9e-c0f7-4e94-bd47-b055dc52d072'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:03:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Delete snapshot completed successfully. Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3c58de2-7de7-44a5-802b-809f5ac1ac09 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "cinder-d79f39b6-bda9-4a94-865a-74a8390f866a-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Flow 'volume_create_manager' (0ed85d4f-971d-45d4-a8ff-d804e78c7da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d67d18-620b-48f1-802f-ae79d6ae0fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d67d18-620b-48f1-802f-ae79d6ae0fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1046974043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d78667-49d9-4277-97d4-10822f3e4a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956dc4100b83414981a49645bcecb72f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:59Z,use_quota=True,user_id='34fd2c0ec2294c1a812256848f7ff62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(892d9ce3-1f67-4f75-b3ca-49b2055ce784),volume_type_id=892d9ce3-1f67-4f75-b3ca-49b2055ce784)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f13fa1-9a01-421d-80e2-9b9f9c160ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f13fa1-9a01-421d-80e2-9b9f9c160ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97d5a03-5072-4aa5-b394-b51a7c513fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97d5a03-5072-4aa5-b394-b51a7c513fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08d78667-49d9-4277-97d4-10822f3e4a5e', 'volume_name': 'volume-08d78667-49d9-4277-97d4-10822f3e4a5e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd1e226-9af3-4f37-9cbc-b6cb48fb16f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd1e226-9af3-4f37-9cbc-b6cb48fb16f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ff08c6c-b5d7-476a-bea4-bd61835732ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Volume 08d78667-49d9-4277-97d4-10822f3e4a5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08d78667-49d9-4277-97d4-10822f3e4a5e', 'volume_size': 1} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1046974043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d78667-49d9-4277-97d4-10822f3e4a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956dc4100b83414981a49645bcecb72f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:59Z,use_quota=True,user_id='34fd2c0ec2294c1a812256848f7ff62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(892d9ce3-1f67-4f75-b3ca-49b2055ce784),volume_type_id=892d9ce3-1f67-4f75-b3ca-49b2055ce784)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Creating volume 08d78667-49d9-4277-97d4-10822f3e4a5e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:03:59 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-08d78667-49d9-4277-97d4-10822f3e4a5e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:59 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-08d78667-49d9-4277-97d4-10822f3e4a5e 1073741824 Sep 04 06:03:59 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Acquiring lock "cinder-8adc1e0d-5671-453b-adc1-08c655b0a6db-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "cinder-8adc1e0d-5671-453b-adc1-08c655b0a6db-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Acquiring lock "cinder-quobyte-8adc1e0d-5671-453b-adc1-08c655b0a6db" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "cinder-quobyte-8adc1e0d-5671-453b-adc1-08c655b0a6db" acquired by "delete_volume" :: waited 0.051s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4aeffc-ce3c-4556-bee8-c5b220dacb99]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Flow 'volume_create_manager' (d94568bf-af3e-4c69-9193-55e6956013e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64034312-ccc1-4b4a-bf4a-ad2cbcc47d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64034312-ccc1-4b4a-bf4a-ad2cbcc47d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-109020197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f66d948-2442-4402-a00f-01c3c5520eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c707c4dc3c0b45c18081cfe7a111561f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:59Z,use_quota=True,user_id='17b807e5f20c4fba854b2ac336496550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcb7948-ff0c-4a64-ba23-c39d7a0d0046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcb7948-ff0c-4a64-ba23-c39d7a0d0046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6ec7a7-fb06-4294-a045-55bc420fc4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6ec7a7-fb06-4294-a045-55bc420fc4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f66d948-2442-4402-a00f-01c3c5520eab', 'volume_name': 'volume-4f66d948-2442-4402-a00f-01c3c5520eab', 'volume_size': 2}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a4945a-ab81-4a77-8e8d-1f0acc2c8387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a4945a-ab81-4a77-8e8d-1f0acc2c8387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e2f0e9-bca9-4c2e-9a19-b680b9594d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:03:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Volume 4f66d948-2442-4402-a00f-01c3c5520eab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f66d948-2442-4402-a00f-01c3c5520eab', 'volume_size': 2} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:03:59 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db Sep 04 06:03:59 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:03:59 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-08d78667-49d9-4277-97d4-10822f3e4a5e 1073741824" returned: 0 in 0.645s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:03:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-08d78667-49d9-4277-97d4-10822f3e4a5e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:03:59 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-08d78667-49d9-4277-97d4-10822f3e4a5e Sep 04 06:03:59 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:00 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Acquiring lock "cinder-7b372f73-7b64-4fe8-b890-fe5d659f8f5f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db" returned: 0 in 0.493s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Lock "cinder-7b372f73-7b64-4fe8-b890-fe5d659f8f5f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:00 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db Sep 04 06:04:00 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Acquiring lock "cinder-quobyte-7b372f73-7b64-4fe8-b890-fe5d659f8f5f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Lock "cinder-quobyte-7b372f73-7b64-4fe8-b890-fe5d659f8f5f" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b3a962-b321-4825-8e19-91c7f0cef389]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:00 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-08d78667-49d9-4277-97d4-10822f3e4a5e" returned: 0 in 0.301s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-109020197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f66d948-2442-4402-a00f-01c3c5520eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c707c4dc3c0b45c18081cfe7a111561f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:59Z,use_quota=True,user_id='17b807e5f20c4fba854b2ac336496550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Creating volume 4f66d948-2442-4402-a00f-01c3c5520eab {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:00 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab 2147483648 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ff08c6c-b5d7-476a-bea4-bd61835732ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d78667-49d9-4277-97d4-10822f3e4a5e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:00 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab 2147483648 Sep 04 06:04:00 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5146ac41-93ef-46f9-a278-57bf7ac43206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:00 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f Sep 04 06:04:00 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Volume volume-08d78667-49d9-4277-97d4-10822f3e4a5e (08d78667-49d9-4277-97d4-10822f3e4a5e): created successfully Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5146ac41-93ef-46f9-a278-57bf7ac43206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Flow 'volume_create_manager' (0ed85d4f-971d-45d4-a8ff-d804e78c7da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-90d600ca-a32f-47fb-9b9a-a8c5d89b1eed tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Created volume successfully. Sep 04 06:04:00 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8adc1e0d-5671-453b-adc1-08c655b0a6db" returned: 0 in 0.283s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "cinder-quobyte-8adc1e0d-5671-453b-adc1-08c655b0a6db" released by "delete_volume" :: held 0.851s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Created reservations ['47e4fb87-e433-4c08-9626-65665c13c8f9', 'd3702a8d-cbe4-4eba-99e8-78180096771c', 'fda63977-0f34-46e1-88de-849b8b352af8', '50cb31a3-170a-43cb-8dcf-d3572a050dd1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:00 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:00 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:00 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:00 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f Sep 04 06:04:00 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:00 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.359s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Deleted volume successfully. Sep 04 06:04:00 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:00 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab 2147483648" returned: 0 in 0.617s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b372f73-7b64-4fe8-b890-fe5d659f8f5f" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Lock "cinder-quobyte-7b372f73-7b64-4fe8-b890-fe5d659f8f5f" released by "delete_volume" :: held 0.753s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b004d84b-0538-4c13-80df-9ac3ff22c431 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003685791 None] Lock "cinder-8adc1e0d-5671-453b-adc1-08c655b0a6db-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:00 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab Sep 04 06:04:00 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Created reservations ['5b756fe8-f1e9-4be2-a5c7-1a56ba616ccd', '2feabfa5-17f6-48cf-892f-8db690628879', '1dc9fbd5-ba08-4d4d-8be1-611118a378ee', 'ee66fdb0-2554-4113-be2c-2b322e740f96'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:01 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:01 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:01 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab" returned: 0 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e2f0e9-bca9-4c2e-9a19-b680b9594d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f66d948-2442-4402-a00f-01c3c5520eab', 'volume_size': 2}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3746fce-f200-4988-8620-440c88c10984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Volume volume-4f66d948-2442-4402-a00f-01c3c5520eab (4f66d948-2442-4402-a00f-01c3c5520eab): created successfully Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3746fce-f200-4988-8620-440c88c10984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Flow 'volume_create_manager' (d94568bf-af3e-4c69-9193-55e6956013e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0e598b3d-b555-4253-86e4-06714429f34c tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Created volume successfully. Sep 04 06:04:01 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Deleted volume successfully. Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c1c7bd85-d445-456c-bafc-f27a4258c627 tempest-VolumesNegativeTest-1623273783 None] Lock "cinder-7b372f73-7b64-4fe8-b890-fe5d659f8f5f-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-915ec7d3-5293-42c3-80d2-a5d7f4aab90f tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-915ec7d3-5293-42c3-80d2-a5d7f4aab90f tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-915ec7d3-5293-42c3-80d2-a5d7f4aab90f tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-915ec7d3-5293-42c3-80d2-a5d7f4aab90f tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-915ec7d3-5293-42c3-80d2-a5d7f4aab90f tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-915ec7d3-5293-42c3-80d2-a5d7f4aab90f tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:01 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:01 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Creating offline snapshot 1450d6ee-91c3-4411-b6dd-d1f1720a7766 of volume 4f66d948-2442-4402-a00f-01c3c5520eab {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:04:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed7fe7c-e523-48a7-8134-783ce0b7923f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:02 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-915ec7d3-5293-42c3-80d2-a5d7f4aab90f tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:02 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-915ec7d3-5293-42c3-80d2-a5d7f4aab90f tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-915ec7d3-5293-42c3-80d2-a5d7f4aab90f tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Retype volume completed successfully. Sep 04 06:04:02 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab Sep 04 06:04:02 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:02 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab" returned: 0 in 0.444s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 2G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:02 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 2G Sep 04 06:04:02 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:03 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 2G" returned: 0 in 0.610s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f66d948-2442-4402-a00f-01c3c5520eab -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Acquiring lock "cinder-08d78667-49d9-4277-97d4-10822f3e4a5e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:03 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f66d948-2442-4402-a00f-01c3c5520eab -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 Sep 04 06:04:03 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Lock "cinder-08d78667-49d9-4277-97d4-10822f3e4a5e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Acquiring lock "cinder-quobyte-08d78667-49d9-4277-97d4-10822f3e4a5e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Lock "cinder-quobyte-08d78667-49d9-4277-97d4-10822f3e4a5e" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b6fe1d-20ba-4122-9577-29d1c59b68c2]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-08d78667-49d9-4277-97d4-10822f3e4a5e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:03 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-08d78667-49d9-4277-97d4-10822f3e4a5e Sep 04 06:04:03 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:03 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f66d948-2442-4402-a00f-01c3c5520eab -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:03 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 is being set with open permissions: ugo+rw Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:03 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 Sep 04 06:04:03 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:03 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-08d78667-49d9-4277-97d4-10822f3e4a5e" returned: 0 in 0.536s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-08d78667-49d9-4277-97d4-10822f3e4a5e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:03 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-08d78667-49d9-4277-97d4-10822f3e4a5e Sep 04 06:04:03 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:03 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766" returned: 0 in 0.342s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:03 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.info Sep 04 06:04:03 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:04 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-08d78667-49d9-4277-97d4-10822f3e4a5e" returned: 0 in 0.308s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Lock "cinder-quobyte-08d78667-49d9-4277-97d4-10822f3e4a5e" released by "delete_volume" :: held 0.904s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:04 devstack cinder-volume[87132]: WARNING cinder.quota [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:04:04 devstack cinder-volume[87132]: WARNING cinder.quota [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Created reservations ['b884c23e-29a3-4b42-a4a0-3c0dabe79b0c', '2e1c5c07-7b1c-47ef-b6b2-fb4b8737ec4f', '44c98208-0b35-4710-949f-ce87e47219df', 'b2027f7a-7408-4716-9404-888621962ab7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:04 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.info" returned: 0 in 0.479s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:04 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.info is being set with open permissions: ugo+rw Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:04 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.info Sep 04 06:04:04 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:04 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:04 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:04 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.info" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.774s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:04 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Deleted volume successfully. Sep 04 06:04:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9dbe160b-c7b7-4918-8d17-7500fea6468d tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Create snapshot completed successfully Sep 04 06:04:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5f6126e6-8dc5-4892-ac1e-74d3726250d4 tempest-VolumeRetypeWithoutMigrationTest-1156634083 None] Lock "cinder-08d78667-49d9-4277-97d4-10822f3e4a5e-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Flow 'volume_create_manager' (65a5d059-b7e6-40bc-a8c1-db4c64dd8c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50f5f61-014a-4b60-b5bf-84f1e5de6de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50f5f61-014a-4b60-b5bf-84f1e5de6de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1418078175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18a0c32-14da-457f-8027-970ac4765493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98bf874666214249819ce157724b06cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:05Z,use_quota=True,user_id='d3935cb14e1d42b98fe86fc59fe88467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7255d673-5cbd-47ed-81a5-99d57b908b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7255d673-5cbd-47ed-81a5-99d57b908b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006497da-aeca-44bf-a487-5fb3474d4541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006497da-aeca-44bf-a487-5fb3474d4541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f18a0c32-14da-457f-8027-970ac4765493', 'volume_name': 'volume-f18a0c32-14da-457f-8027-970ac4765493', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49359de0-e93c-4ec4-836f-1b23b6ed1a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49359de0-e93c-4ec4-836f-1b23b6ed1a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccee2b67-fbfa-4c58-b902-df752f505443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Volume f18a0c32-14da-457f-8027-970ac4765493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f18a0c32-14da-457f-8027-970ac4765493', 'volume_size': 1} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1418078175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18a0c32-14da-457f-8027-970ac4765493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98bf874666214249819ce157724b06cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:05Z,use_quota=True,user_id='d3935cb14e1d42b98fe86fc59fe88467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Creating volume f18a0c32-14da-457f-8027-970ac4765493 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:05 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:05 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 1073741824 Sep 04 06:04:05 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Acquiring lock "cinder-1450d6ee-91c3-4411-b6dd-d1f1720a7766-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "cinder-1450d6ee-91c3-4411-b6dd-d1f1720a7766-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Acquiring lock "cinder-quobyte-4f66d948-2442-4402-a00f-01c3c5520eab" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "cinder-quobyte-4f66d948-2442-4402-a00f-01c3c5520eab" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Acquiring lock "cinder-quobyte-1450d6ee-91c3-4411-b6dd-d1f1720a7766" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "cinder-quobyte-1450d6ee-91c3-4411-b6dd-d1f1720a7766" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Deleting offline snapshot 1450d6ee-91c3-4411-b6dd-d1f1720a7766 of volume 4f66d948-2442-4402-a00f-01c3c5520eab {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] snapshot_file for this snap is: volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[191a0761-7360-4dd0-8434-519ef51fdd27]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:05 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 Sep 04 06:04:05 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:05 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 1073741824" returned: 0 in 0.561s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:05 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766" returned: 0 in 0.469s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f66d948-2442-4402-a00f-01c3c5520eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:04:05 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 Sep 04 06:04:05 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0abff11-5e86-48c9-8e60-cd4d8b8c1251]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:05 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab Sep 04 06:04:05 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:06 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccee2b67-fbfa-4c58-b902-df752f505443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18a0c32-14da-457f-8027-970ac4765493', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328a94f1-86b0-4dbf-8712-10ad2322d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Volume volume-f18a0c32-14da-457f-8027-970ac4765493 (f18a0c32-14da-457f-8027-970ac4765493): created successfully Sep 04 06:04:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328a94f1-86b0-4dbf-8712-10ad2322d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Flow 'volume_create_manager' (65a5d059-b7e6-40bc-a8c1-db4c64dd8c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-89a53887-0227-490e-97c0-5c69a0dcb611 tempest-VolumesSnapshotListTestJSON-1911571974 None] Created volume successfully. Sep 04 06:04:06 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab" returned: 0 in 0.463s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:06 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 Sep 04 06:04:06 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:06 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766" returned: 0 in 0.402s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:06 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766 Sep 04 06:04:06 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:06 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab.1450d6ee-91c3-4411-b6dd-d1f1720a7766" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "cinder-quobyte-1450d6ee-91c3-4411-b6dd-d1f1720a7766" released by "_delete_snapshot" :: held 1.765s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "cinder-quobyte-4f66d948-2442-4402-a00f-01c3c5520eab" released by "delete_snapshot" :: held 1.794s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Created reservations ['fc3efc97-a68b-4aea-90f0-312cb23fccd5', '18570389-e66e-426e-b021-5eb997c5f9bb', 'fd88d8cb-75d0-4d7a-858f-a92811b2a96b', '99f6ff57-ef5f-4b24-a36a-d68b868e05aa'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Delete snapshot completed successfully. Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39037329-61b2-4737-91af-56f6f9f9f0c5 tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "cinder-1450d6ee-91c3-4411-b6dd-d1f1720a7766-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] Creating offline snapshot f9059db8-91e9-4000-bd0a-5e02c6674180 of volume f18a0c32-14da-457f-8027-970ac4765493 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b5db66-5022-4ede-9dd4-8f3e9685c529]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Acquiring lock "cinder-4f66d948-2442-4402-a00f-01c3c5520eab-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "cinder-4f66d948-2442-4402-a00f-01c3c5520eab-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:07 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 Sep 04 06:04:07 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Acquiring lock "cinder-quobyte-4f66d948-2442-4402-a00f-01c3c5520eab" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "cinder-quobyte-4f66d948-2442-4402-a00f-01c3c5520eab" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b46a4a-896a-4ed9-ab45-d75666463152]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:07 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab Sep 04 06:04:07 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:08 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493" returned: 0 in 0.484s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:08 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 1G Sep 04 06:04:08 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:08 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab" returned: 0 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:08 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab Sep 04 06:04:08 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:08 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4f66d948-2442-4402-a00f-01c3c5520eab" returned: 0 in 0.304s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "cinder-quobyte-4f66d948-2442-4402-a00f-01c3c5520eab" released by "delete_volume" :: held 0.885s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:08 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 1G" returned: 0 in 0.616s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18a0c32-14da-457f-8027-970ac4765493 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:08 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18a0c32-14da-457f-8027-970ac4765493 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 Sep 04 06:04:08 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Created reservations ['0e44f7a1-091b-483a-9095-d9234fdef3dc', 'b038e25a-fe55-44b5-a32e-f5717f4cd73a', '1bb538ae-9b2f-476c-81c3-65bbbdaf16f8', 'ac99daa1-1464-4d9e-bdbc-b7a90458d271'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:09 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:09 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:09 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18a0c32-14da-457f-8027-970ac4765493 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180" returned: 0 in 0.472s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:09 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 is being set with open permissions: ugo+rw Sep 04 06:04:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:09 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 Sep 04 06:04:09 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:09 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.371s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:09 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Deleted volume successfully. Sep 04 06:04:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6dd48838-47d2-435e-a469-40242e89d75f tempest-VolumesSnapshotNegativeTestJSON-1788552980 None] Lock "cinder-4f66d948-2442-4402-a00f-01c3c5520eab-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:09 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180" returned: 0 in 0.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:09 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.info Sep 04 06:04:09 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:09 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.info" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:09 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.info is being set with open permissions: ugo+rw Sep 04 06:04:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:09 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.info Sep 04 06:04:09 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:10 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.info" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.706s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f1c533eb-42ff-4b52-8317-14527ab89523 tempest-VolumesSnapshotListTestJSON-1911571974 None] Create snapshot completed successfully Sep 04 06:04:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] Creating offline snapshot e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 of volume f18a0c32-14da-457f-8027-970ac4765493 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:04:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed19a5-e183-4374-a6b9-a46ea08f6219]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:11 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 Sep 04 06:04:11 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:11 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180" returned: 0 in 0.548s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18a0c32-14da-457f-8027-970ac4765493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:04:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:11 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 1G Sep 04 06:04:11 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:12 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 1G" returned: 0 in 0.591s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:12 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 Sep 04 06:04:12 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:12 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8" returned: 0 in 0.408s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:12 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 is being set with open permissions: ugo+rw Sep 04 06:04:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:12 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 Sep 04 06:04:12 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:13 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8" returned: 0 in 0.323s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ac7678d2-2664-44a3-9506-de4fafb6b9ff tempest-VolumesSnapshotListTestJSON-1911571974 None] Create snapshot completed successfully Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Flow 'volume_create_manager' (17b3f5a2-a5d0-4215-82c7-b76a77b8e115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73531dc9-8d66-409e-9dc5-71554a154cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73531dc9-8d66-409e-9dc5-71554a154cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1752918177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd623e7-cd69-40b6-9c0c-91665f9a00be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cab9f0a4aa4f00bdf0394983f785bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:13Z,use_quota=True,user_id='105419aad7eb497b99c0e86b3dd9b615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d997c003-42d1-4336-80d7-496378638c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d997c003-42d1-4336-80d7-496378638c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17601973-ba3f-4447-a42f-f592a1ab6b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17601973-ba3f-4447-a42f-f592a1ab6b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd623e7-cd69-40b6-9c0c-91665f9a00be', 'volume_name': 'volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee84867-b475-49a1-93e2-9a1358ea1107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee84867-b475-49a1-93e2-9a1358ea1107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1a58dc-64f3-4d44-91e9-9fba4f450766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Volume 9bd623e7-cd69-40b6-9c0c-91665f9a00be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be', 'volume_size': 1} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1752918177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd623e7-cd69-40b6-9c0c-91665f9a00be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cab9f0a4aa4f00bdf0394983f785bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:13Z,use_quota=True,user_id='105419aad7eb497b99c0e86b3dd9b615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Creating volume 9bd623e7-cd69-40b6-9c0c-91665f9a00be {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:13 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:13 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be 1073741824 Sep 04 06:04:13 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:14 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be 1073741824" returned: 0 in 0.576s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:14 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be Sep 04 06:04:14 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Flow 'volume_create_manager' (9a684367-eb70-4165-837c-af062918abc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780a1dd3-d316-44de-bd95-10ce58ade4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780a1dd3-d316-44de-bd95-10ce58ade4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1959378667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e89bcd2-7901-4d51-b0d9-f7674717c4b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e9b98e520b455eb2103a4a2e08f917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:14Z,use_quota=True,user_id='ee1e70b1861e4b31802a68e3a5bf6b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:14 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576e9ed4-a598-4337-9ebf-7cfc045e1486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576e9ed4-a598-4337-9ebf-7cfc045e1486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdbbb7b-f0ec-4192-a22d-07471d2437e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdbbb7b-f0ec-4192-a22d-07471d2437e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e89bcd2-7901-4d51-b0d9-f7674717c4b6', 'volume_name': 'volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c696c53-6505-4a2b-9225-58d49da9f57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c696c53-6505-4a2b-9225-58d49da9f57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f4c2fd-2759-4770-89fd-2a54b9d35ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Volume 6e89bcd2-7901-4d51-b0d9-f7674717c4b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6', 'volume_size': 1} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be" returned: 0 in 0.526s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.114s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1a58dc-64f3-4d44-91e9-9fba4f450766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406c938e-3497-4749-9ec6-a28e3128acf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] Creating offline snapshot bb2c20d5-4f8b-44b9-af3e-bd20d798615e of volume f18a0c32-14da-457f-8027-970ac4765493 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:04:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Volume volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be (9bd623e7-cd69-40b6-9c0c-91665f9a00be): created successfully Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406c938e-3497-4749-9ec6-a28e3128acf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Flow 'volume_create_manager' (17b3f5a2-a5d0-4215-82c7-b76a77b8e115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b810af-bab3-4fa2-ba88-2af4d4797d30]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bfd4526d-5c3d-4a3c-a855-cd8e9c90063b tempest-VolumesServicesTestJSON-1334851336 None] Created volume successfully. Sep 04 06:04:14 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 Sep 04 06:04:14 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:14 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Flow 'volume_create_manager' (04343ff1-48a3-46aa-a313-7aa54f2c9032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90c0e36-4e8b-4adc-baea-8816c7001b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90c0e36-4e8b-4adc-baea-8816c7001b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2006809472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e9b98e520b455eb2103a4a2e08f917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:15Z,use_quota=True,user_id='ee1e70b1861e4b31802a68e3a5bf6b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c729cb1-a430-4ccd-aeec-809fab0b3e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c729cb1-a430-4ccd-aeec-809fab0b3e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366e2a7e-bc12-49c9-945a-3713d4b11f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366e2a7e-bc12-49c9-945a-3713d4b11f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394', 'volume_name': 'volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed9318d-99e9-43ca-a368-4c98b8ed009b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed9318d-99e9-43ca-a368-4c98b8ed009b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939f33b3-0bfa-4a26-820f-507c69c0c1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Volume bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394', 'volume_size': 1} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:15 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8" returned: 0 in 0.468s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18a0c32-14da-457f-8027-970ac4765493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:15 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e 1G Sep 04 06:04:15 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Flow 'volume_create_manager' (88775786-e6ad-4965-b905-25d2ba3853cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c08205-163b-4a41-acb8-d943ae707fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c08205-163b-4a41-acb8-d943ae707fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1906428347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54310825-0f18-4af4-81d9-da49dd9c6587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e9b98e520b455eb2103a4a2e08f917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:15Z,use_quota=True,user_id='ee1e70b1861e4b31802a68e3a5bf6b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2152bd-de96-4a0e-b9a2-cfedbdef2d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2152bd-de96-4a0e-b9a2-cfedbdef2d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2f65c7-a3e9-4999-8725-5e7f673a267a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2f65c7-a3e9-4999-8725-5e7f673a267a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54310825-0f18-4af4-81d9-da49dd9c6587', 'volume_name': 'volume-54310825-0f18-4af4-81d9-da49dd9c6587', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dffc7ee-dd9d-4cdb-ae39-11147ae7d9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dffc7ee-dd9d-4cdb-ae39-11147ae7d9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378a266f-25ae-47ea-8af5-3224c15f274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Volume 54310825-0f18-4af4-81d9-da49dd9c6587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54310825-0f18-4af4-81d9-da49dd9c6587', 'volume_size': 1} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:15 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Flow 'volume_create_manager' (c05d68f1-0dec-4d0c-9048-6636f7604b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45309178-4865-4270-9a28-78206906228f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e 1G" returned: 0 in 0.637s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45309178-4865-4270-9a28-78206906228f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1354465242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2185d815-c5f7-448e-b06a-59eaf1c5f1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e9b98e520b455eb2103a4a2e08f917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:16Z,use_quota=True,user_id='ee1e70b1861e4b31802a68e3a5bf6b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:15 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210a3210-625a-4e49-8398-b22c3c53ca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210a3210-625a-4e49-8398-b22c3c53ca56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877b92f9-9c59-48cb-9776-744f8dfd3616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877b92f9-9c59-48cb-9776-744f8dfd3616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2185d815-c5f7-448e-b06a-59eaf1c5f1d4', 'volume_name': 'volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46637978-38a5-4cef-8b3a-e67956a0b34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46637978-38a5-4cef-8b3a-e67956a0b34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f939f5de-5d5b-4948-851b-5a1c96d184cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Volume 2185d815-c5f7-448e-b06a-59eaf1c5f1d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4', 'volume_size': 1} Sep 04 06:04:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Acquiring lock "cinder-9bd623e7-cd69-40b6-9c0c-91665f9a00be-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Lock "cinder-9bd623e7-cd69-40b6-9c0c-91665f9a00be-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Acquiring lock "cinder-quobyte-9bd623e7-cd69-40b6-9c0c-91665f9a00be" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Lock "cinder-quobyte-9bd623e7-cd69-40b6-9c0c-91665f9a00be" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[154703cc-84e3-43c9-828d-4c8fb379dfe3]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:16 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:16 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e is being set with open permissions: ugo+rw Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:16 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e Sep 04 06:04:16 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:16 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be Sep 04 06:04:16 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Flow 'volume_create_manager' (e0d45d87-4e33-4e42-882a-b9e3d7da5a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66dff96c-6ed1-4322-929c-878e9e5b01b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66dff96c-6ed1-4322-929c-878e9e5b01b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1977436487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e9b98e520b455eb2103a4a2e08f917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:16Z,use_quota=True,user_id='ee1e70b1861e4b31802a68e3a5bf6b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1278bbc4-bc57-4971-a628-e6aae0707c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1278bbc4-bc57-4971-a628-e6aae0707c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0110eb9c-5f53-41b0-b53c-6590940e8221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0110eb9c-5f53-41b0-b53c-6590940e8221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc', 'volume_name': 'volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fea305-e381-489e-8942-b87c06b8e35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fea305-e381-489e-8942-b87c06b8e35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2896676-2b6a-49c4-a6ad-28152204323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Volume 5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc', 'volume_size': 1} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:16 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e" returned: 0 in 0.319s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1959378667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e89bcd2-7901-4d51-b0d9-f7674717c4b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e9b98e520b455eb2103a4a2e08f917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:14Z,use_quota=True,user_id='ee1e70b1861e4b31802a68e3a5bf6b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Creating volume 6e89bcd2-7901-4d51-b0d9-f7674717c4b6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:16 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:16 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be" returned: 0 in 0.453s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:16 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6 1073741824 Sep 04 06:04:16 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-adbc49aa-98f3-4e4a-8a8c-15441a29f540 tempest-VolumesSnapshotListTestJSON-1911571974 None] Create snapshot completed successfully Sep 04 06:04:16 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be Sep 04 06:04:16 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:17 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9bd623e7-cd69-40b6-9c0c-91665f9a00be" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Lock "cinder-quobyte-9bd623e7-cd69-40b6-9c0c-91665f9a00be" released by "delete_volume" :: held 0.806s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Created reservations ['c9252bab-a393-46f2-a304-b0d9db6821fe', '4f289e6c-88e7-4b92-b7d9-b32bc56a138b', 'f2e6d48b-398c-481d-9497-8eaa285a0e45', '73043ca0-792c-4d71-8207-739ddfe32e44'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:17 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6 1073741824" returned: 0 in 0.513s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:17 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:17 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:17 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6 Sep 04 06:04:17 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:17 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Deleted volume successfully. Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-570fe722-ae28-44a5-a315-84faadcf3301 tempest-VolumesServicesTestJSON-1334851336 None] Lock "cinder-9bd623e7-cd69-40b6-9c0c-91665f9a00be-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:17 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6" returned: 0 in 0.329s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.434s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2006809472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e9b98e520b455eb2103a4a2e08f917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:15Z,use_quota=True,user_id='ee1e70b1861e4b31802a68e3a5bf6b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Creating volume bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:17 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f4c2fd-2759-4770-89fd-2a54b9d35ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:17 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394 1073741824 Sep 04 06:04:17 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45c6acc-266f-414a-86a9-b7cb76275065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Volume volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6 (6e89bcd2-7901-4d51-b0d9-f7674717c4b6): created successfully Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45c6acc-266f-414a-86a9-b7cb76275065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Flow 'volume_create_manager' (9a684367-eb70-4165-837c-af062918abc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f4a2bc66-13e5-46d4-92fd-6c1d9f2c5398 tempest-CreateVolumesFromImageTest-1022388393 None] Created volume successfully. Sep 04 06:04:18 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394 1073741824" returned: 0 in 0.584s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:18 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394 Sep 04 06:04:18 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:18 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.102s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1906428347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54310825-0f18-4af4-81d9-da49dd9c6587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e9b98e520b455eb2103a4a2e08f917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:15Z,use_quota=True,user_id='ee1e70b1861e4b31802a68e3a5bf6b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Creating volume 54310825-0f18-4af4-81d9-da49dd9c6587 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:18 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54310825-0f18-4af4-81d9-da49dd9c6587 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:18 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54310825-0f18-4af4-81d9-da49dd9c6587 1073741824 Sep 04 06:04:18 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939f33b3-0bfa-4a26-820f-507c69c0c1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bb0f0b-4ba1-4253-b4bb-c07e08c4c06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Volume volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394 (bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394): created successfully Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bb0f0b-4ba1-4253-b4bb-c07e08c4c06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Flow 'volume_create_manager' (04343ff1-48a3-46aa-a313-7aa54f2c9032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-59379016-8e21-4227-9368-16fd8e491283 tempest-CreateVolumesFromImageTest-1022388393 None] Created volume successfully. Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "cinder-bb2c20d5-4f8b-44b9-af3e-bd20d798615e-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-bb2c20d5-4f8b-44b9-af3e-bd20d798615e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "cinder-quobyte-f18a0c32-14da-457f-8027-970ac4765493" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-f18a0c32-14da-457f-8027-970ac4765493" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "cinder-quobyte-bb2c20d5-4f8b-44b9-af3e-bd20d798615e" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-bb2c20d5-4f8b-44b9-af3e-bd20d798615e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Deleting offline snapshot bb2c20d5-4f8b-44b9-af3e-bd20d798615e of volume f18a0c32-14da-457f-8027-970ac4765493 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] snapshot_file for this snap is: volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fa6f04-801f-42fd-8379-2eba3125efa0]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:19 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e Sep 04 06:04:19 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:19 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54310825-0f18-4af4-81d9-da49dd9c6587 1073741824" returned: 0 in 0.711s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54310825-0f18-4af4-81d9-da49dd9c6587 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:19 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54310825-0f18-4af4-81d9-da49dd9c6587 Sep 04 06:04:19 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:19 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e" returned: 0 in 0.588s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18a0c32-14da-457f-8027-970ac4765493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b4f612-0706-4bc9-beda-8932951ab667]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:19 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54310825-0f18-4af4-81d9-da49dd9c6587" returned: 0 in 0.389s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.865s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1354465242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2185d815-c5f7-448e-b06a-59eaf1c5f1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e9b98e520b455eb2103a4a2e08f917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:16Z,use_quota=True,user_id='ee1e70b1861e4b31802a68e3a5bf6b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Creating volume 2185d815-c5f7-448e-b06a-59eaf1c5f1d4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:19 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:19 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4 1073741824 Sep 04 06:04:19 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378a266f-25ae-47ea-8af5-3224c15f274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54310825-0f18-4af4-81d9-da49dd9c6587', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b8dd02-a0a0-4dd1-b92c-6a108a1f0b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Volume volume-54310825-0f18-4af4-81d9-da49dd9c6587 (54310825-0f18-4af4-81d9-da49dd9c6587): created successfully Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b8dd02-a0a0-4dd1-b92c-6a108a1f0b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Flow 'volume_create_manager' (88775786-e6ad-4965-b905-25d2ba3853cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5bebcdd9-b05d-408f-b0a2-4089fc471e86 tempest-CreateVolumesFromImageTest-1022388393 None] Created volume successfully. Sep 04 06:04:19 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 Sep 04 06:04:19 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:20 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18a0c32-14da-457f-8027-970ac4765493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:20 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e Sep 04 06:04:20 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:20 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4 1073741824" returned: 0 in 0.611s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:20 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4 Sep 04 06:04:20 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:20 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4" returned: 0 in 0.329s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.359s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1977436487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e9b98e520b455eb2103a4a2e08f917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:16Z,use_quota=True,user_id='ee1e70b1861e4b31802a68e3a5bf6b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Creating volume 5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:20 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f939f5de-5d5b-4948-851b-5a1c96d184cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae52f22f-b02b-4606-bd64-e9ee697f7e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:20 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc 1073741824 Sep 04 06:04:20 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Volume volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4 (2185d815-c5f7-448e-b06a-59eaf1c5f1d4): created successfully Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae52f22f-b02b-4606-bd64-e9ee697f7e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Flow 'volume_create_manager' (c05d68f1-0dec-4d0c-9048-6636f7604b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b32f64a9-67ef-4f25-997e-63fdde2cb9e1 tempest-CreateVolumesFromImageTest-1022388393 None] Created volume successfully. Sep 04 06:04:20 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e" returned: 0 in 0.644s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:21 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e Sep 04 06:04:21 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:21 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.bb2c20d5-4f8b-44b9-af3e-bd20d798615e" returned: 0 in 0.329s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-bb2c20d5-4f8b-44b9-af3e-bd20d798615e" released by "_delete_snapshot" :: held 2.162s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-f18a0c32-14da-457f-8027-970ac4765493" released by "delete_snapshot" :: held 2.194s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Created reservations ['07362c77-c664-4592-af96-bf8d341cabc2', '14263ba3-3759-4e69-8acc-b2aa33a7e6f0', 'c022a61f-4e95-4525-8e74-86af777bb9f0', '514ac9da-e03e-4b77-b544-28b0e163ff40'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:21 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc 1073741824" returned: 0 in 0.610s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Delete snapshot completed successfully. Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c3326f21-8d15-463b-ae42-a8129c07a862 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-bb2c20d5-4f8b-44b9-af3e-bd20d798615e-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:21 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc Sep 04 06:04:21 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:21 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc" returned: 0 in 0.308s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2896676-2b6a-49c4-a6ad-28152204323e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06947eb3-1fbb-46ba-9175-f28643169ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Volume volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc (5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc): created successfully Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06947eb3-1fbb-46ba-9175-f28643169ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Flow 'volume_create_manager' (e0d45d87-4e33-4e42-882a-b9e3d7da5a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b3af96de-d0ba-4306-98e4-337b7bc1c018 tempest-CreateVolumesFromImageTest-1022388393 None] Created volume successfully. Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "cinder-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "cinder-quobyte-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-quobyte-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b68ba3-265e-4341-b625-cc0d5bd11abb]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "cinder-e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "cinder-quobyte-f18a0c32-14da-457f-8027-970ac4765493" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-f18a0c32-14da-457f-8027-970ac4765493" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "cinder-quobyte-e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Deleting offline snapshot e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 of volume f18a0c32-14da-457f-8027-970ac4765493 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] snapshot_file for this snap is: volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5800159d-0cba-4907-be26-a357ca0c2052]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:22 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc Sep 04 06:04:22 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:22 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 Sep 04 06:04:22 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:22 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc" returned: 0 in 0.526s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:22 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc Sep 04 06:04:22 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:22 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8" returned: 0 in 0.435s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18a0c32-14da-457f-8027-970ac4765493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[99003750-9df3-4d18-a75c-0a0889f82d28]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:23 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 Sep 04 06:04:23 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:23 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc" returned: 0 in 0.281s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-quobyte-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc" released by "delete_volume" :: held 0.863s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Created reservations ['1961e713-6501-46d0-b898-d23231e5b258', '65cb9d64-e058-4941-9152-05c1ee69ce21', '84555332-019a-4182-99fa-8371abe84e1c', '9c7447d8-b8e9-4f34-8402-a1732ff34b23'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:23 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:23 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "cinder-2185d815-c5f7-448e-b06a-59eaf1c5f1d4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-2185d815-c5f7-448e-b06a-59eaf1c5f1d4-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:23 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180" returned: 0 in 0.578s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18a0c32-14da-457f-8027-970ac4765493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:23 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 Sep 04 06:04:23 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "cinder-quobyte-2185d815-c5f7-448e-b06a-59eaf1c5f1d4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-quobyte-2185d815-c5f7-448e-b06a-59eaf1c5f1d4" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[085906cb-63bc-4a18-ab48-350d0f3cb821]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:23 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.401s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Deleted volume successfully. Sep 04 06:04:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e525dbdd-f2e1-43f3-b3c1-20e94b06d329 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-5c5e7b7f-a40a-42b0-8a60-7bfd29f6fedc-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:23 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4 Sep 04 06:04:23 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:24 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8" returned: 0 in 0.538s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:24 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8 Sep 04 06:04:24 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:24 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4" returned: 0 in 0.456s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:24 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4 Sep 04 06:04:24 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:24 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8" returned: 0 in 0.310s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8" released by "_delete_snapshot" :: held 1.991s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-f18a0c32-14da-457f-8027-970ac4765493" released by "delete_snapshot" :: held 2.021s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:24 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2185d815-c5f7-448e-b06a-59eaf1c5f1d4" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-quobyte-2185d815-c5f7-448e-b06a-59eaf1c5f1d4" released by "delete_volume" :: held 0.871s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Created reservations ['d22f74a8-cbef-482e-a64a-dddc6fc7ff8e', 'e4368dc2-d80c-4f9e-8bc0-8636d06a83e3', '9bd2510c-0d24-430b-b467-70853687d5e1', '6ea2316b-23a6-4030-bbbd-b153cc27322b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Created reservations ['54660bee-ef1b-47dc-9a02-45f5432b847a', 'd1f8d9a0-488a-465b-b9c0-b88b48842ec2', '313cefad-74c4-4e6f-85a5-1e1c179c208e', '29dd81fe-2427-4162-a1e0-5ff73bdb25fb'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Delete snapshot completed successfully. Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9edbb6f8-289a-4328-bc75-a34b25983e6d tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-e5df7c7a-d47a-4dd2-b913-a6ea85dfb5e8-delete_snapshot" released by "delete_snapshot" :: held 2.338s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:24 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:24 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:25 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Flow 'volume_create_manager' (48451c83-64a4-4884-8573-931f34510090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1357774c-472c-4ad8-8c53-e5b9412829ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Deleted volume successfully. Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1357774c-472c-4ad8-8c53-e5b9412829ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1329315846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58958271-8152-4b89-9272-cd813770f67f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35ed305c3ca47f9afba72b02c36ad94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:25Z,use_quota=True,user_id='7d4d2795ffb340fa97c09e291b88a30b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c18ff83-7653-4a39-8d37-d2b94a7bf5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c18ff83-7653-4a39-8d37-d2b94a7bf5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358ae9af-cde8-4a1b-b1c7-876111091855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358ae9af-cde8-4a1b-b1c7-876111091855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58958271-8152-4b89-9272-cd813770f67f', 'volume_name': 'volume-58958271-8152-4b89-9272-cd813770f67f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0d240d-a573-475c-8481-a0b173d5da0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0d240d-a573-475c-8481-a0b173d5da0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad9b749-c981-419f-9ab5-0505cc245cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Volume 58958271-8152-4b89-9272-cd813770f67f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58958271-8152-4b89-9272-cd813770f67f', 'volume_size': 1} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1329315846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58958271-8152-4b89-9272-cd813770f67f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35ed305c3ca47f9afba72b02c36ad94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:25Z,use_quota=True,user_id='7d4d2795ffb340fa97c09e291b88a30b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Creating volume 58958271-8152-4b89-9272-cd813770f67f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:25 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58958271-8152-4b89-9272-cd813770f67f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-686fdece-d717-420c-a1fc-3f01277a78ca tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-2185d815-c5f7-448e-b06a-59eaf1c5f1d4-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:25 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58958271-8152-4b89-9272-cd813770f67f 1073741824 Sep 04 06:04:25 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:25 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:25 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:25 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "cinder-f9059db8-91e9-4000-bd0a-5e02c6674180-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:25 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58958271-8152-4b89-9272-cd813770f67f 1073741824" returned: 0 in 0.502s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-f9059db8-91e9-4000-bd0a-5e02c6674180-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "cinder-quobyte-f18a0c32-14da-457f-8027-970ac4765493" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-f18a0c32-14da-457f-8027-970ac4765493" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "cinder-quobyte-f9059db8-91e9-4000-bd0a-5e02c6674180" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-f9059db8-91e9-4000-bd0a-5e02c6674180" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Deleting offline snapshot f9059db8-91e9-4000-bd0a-5e02c6674180 of volume f18a0c32-14da-457f-8027-970ac4765493 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] snapshot_file for this snap is: volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58958271-8152-4b89-9272-cd813770f67f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e56750-b186-4df0-a5bc-65d8e6692115]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:25 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58958271-8152-4b89-9272-cd813770f67f Sep 04 06:04:25 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "cinder-54310825-0f18-4af4-81d9-da49dd9c6587-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-54310825-0f18-4af4-81d9-da49dd9c6587-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "cinder-quobyte-54310825-0f18-4af4-81d9-da49dd9c6587" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-quobyte-54310825-0f18-4af4-81d9-da49dd9c6587" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:25 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 Sep 04 06:04:25 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[863ad5cc-ab2b-47da-ab51-bc88bf84af08]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54310825-0f18-4af4-81d9-da49dd9c6587 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:26 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54310825-0f18-4af4-81d9-da49dd9c6587 Sep 04 06:04:26 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:26 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58958271-8152-4b89-9272-cd813770f67f" returned: 0 in 0.430s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad9b749-c981-419f-9ab5-0505cc245cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58958271-8152-4b89-9272-cd813770f67f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfdb3a7-f18b-4d28-8dde-0ed122386b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Volume volume-58958271-8152-4b89-9272-cd813770f67f (58958271-8152-4b89-9272-cd813770f67f): created successfully Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfdb3a7-f18b-4d28-8dde-0ed122386b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Flow 'volume_create_manager' (48451c83-64a4-4884-8573-931f34510090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4aaf3c5b-953d-474e-b310-494cd1a535a2 tempest-VolumesListAdminTestJSON-1420074374 None] Created volume successfully. Sep 04 06:04:26 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18a0c32-14da-457f-8027-970ac4765493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a183220-9ff3-445a-b236-54800c41e8e3]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:26 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54310825-0f18-4af4-81d9-da49dd9c6587" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54310825-0f18-4af4-81d9-da49dd9c6587 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:26 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54310825-0f18-4af4-81d9-da49dd9c6587 Sep 04 06:04:26 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:26 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 Sep 04 06:04:26 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:26 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-54310825-0f18-4af4-81d9-da49dd9c6587" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-quobyte-54310825-0f18-4af4-81d9-da49dd9c6587" released by "delete_volume" :: held 0.710s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Created reservations ['9a47ea32-6bdd-4693-8b0f-b7afe2ea8151', 'd2f635a0-d57b-4275-9099-47e85e54a924', 'f7895d0f-70d1-457f-ab5a-f56c8495cfad', '2e1d6071-cb2a-46ab-9b16-b76573840f72'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:26 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493" returned: 0 in 0.451s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:26 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 Sep 04 06:04:26 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:26 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:26 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "cinder-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:27 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "cinder-quobyte-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Deleted volume successfully. Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-quobyte-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-495a0145-ecc9-4227-8f2d-ed1a3f31ed01 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-54310825-0f18-4af4-81d9-da49dd9c6587-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbd31ec-3468-43be-927b-928229303773]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:27 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180" returned: 0 in 0.527s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:27 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180 Sep 04 06:04:27 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:27 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394 Sep 04 06:04:27 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:27 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493.f9059db8-91e9-4000-bd0a-5e02c6674180" returned: 0 in 0.284s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-f9059db8-91e9-4000-bd0a-5e02c6674180" released by "_delete_snapshot" :: held 1.905s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-f18a0c32-14da-457f-8027-970ac4765493" released by "delete_snapshot" :: held 1.951s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Created reservations ['b8d0455b-335a-4528-b58b-99280e64c338', '9e5f8019-b9a7-4e56-a2fa-83ba145a027f', 'ab782553-8ec7-4237-8227-3232af3eec61', 'c52b53aa-f6f6-443d-a68c-d8bf2c8f9c71'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:27 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394" returned: 0 in 0.538s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:27 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394 Sep 04 06:04:27 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Delete snapshot completed successfully. Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d14d0827-b4f0-44c1-af21-3d6ab82b4574 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-f9059db8-91e9-4000-bd0a-5e02c6674180-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Flow 'volume_create_manager' (59a5bf5b-775d-40c4-a4d3-9cceef1e261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2cd36c5-29ec-4da2-bd00-7f72a3599b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2cd36c5-29ec-4da2-bd00-7f72a3599b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-243865746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7aab1be-c0a0-43d7-a434-20737e867cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35ed305c3ca47f9afba72b02c36ad94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:28Z,use_quota=True,user_id='7d4d2795ffb340fa97c09e291b88a30b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df14381-7edf-443b-a065-bc9073a6db45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df14381-7edf-443b-a065-bc9073a6db45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85158cdb-a3d0-443a-b556-78341dc056a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85158cdb-a3d0-443a-b556-78341dc056a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7aab1be-c0a0-43d7-a434-20737e867cff', 'volume_name': 'volume-f7aab1be-c0a0-43d7-a434-20737e867cff', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04d8c46-266a-4623-b3cf-ec611aebe41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04d8c46-266a-4623-b3cf-ec611aebe41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03eda000-d73c-421a-9ae6-657ac7809d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:27 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Volume f7aab1be-c0a0-43d7-a434-20737e867cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7aab1be-c0a0-43d7-a434-20737e867cff', 'volume_size': 1} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-243865746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7aab1be-c0a0-43d7-a434-20737e867cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35ed305c3ca47f9afba72b02c36ad94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:28Z,use_quota=True,user_id='7d4d2795ffb340fa97c09e291b88a30b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Creating volume f7aab1be-c0a0-43d7-a434-20737e867cff {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:27 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f7aab1be-c0a0-43d7-a434-20737e867cff 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:28 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f7aab1be-c0a0-43d7-a434-20737e867cff 1073741824 Sep 04 06:04:28 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:28 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-quobyte-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394" released by "delete_volume" :: held 0.887s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Created reservations ['c7bf945e-bb2e-43de-8924-4b559085d28c', '984b79d5-e7e8-4065-bde5-fb5111953528', '2c0e702f-e425-4d9a-a3fc-88e4d4775936', '5489b1d2-5c60-4746-892b-bd156ac26ba3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:28 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:28 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:28 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f7aab1be-c0a0-43d7-a434-20737e867cff 1073741824" returned: 0 in 0.496s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f7aab1be-c0a0-43d7-a434-20737e867cff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:28 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:28 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f7aab1be-c0a0-43d7-a434-20737e867cff Sep 04 06:04:28 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Deleted volume successfully. Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29b47bd2-96eb-4914-b378-0d688970b297 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-bd0a9fc1-c88b-4c04-bd9f-bc0bc4003394-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:28 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f7aab1be-c0a0-43d7-a434-20737e867cff" returned: 0 in 0.269s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03eda000-d73c-421a-9ae6-657ac7809d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7aab1be-c0a0-43d7-a434-20737e867cff', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a4a942-8877-4b1b-acf6-3a162483d2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Volume volume-f7aab1be-c0a0-43d7-a434-20737e867cff (f7aab1be-c0a0-43d7-a434-20737e867cff): created successfully Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a4a942-8877-4b1b-acf6-3a162483d2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Flow 'volume_create_manager' (59a5bf5b-775d-40c4-a4d3-9cceef1e261d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ce7e63d3-d2a9-4fd1-b3fb-642f5b1fa07b tempest-VolumesListAdminTestJSON-1420074374 None] Created volume successfully. Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "cinder-f18a0c32-14da-457f-8027-970ac4765493-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-f18a0c32-14da-457f-8027-970ac4765493-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "cinder-quobyte-f18a0c32-14da-457f-8027-970ac4765493" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-f18a0c32-14da-457f-8027-970ac4765493" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca324d21-1bfb-4e99-b0b4-91750c2c6d1b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:29 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 Sep 04 06:04:29 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Flow 'volume_create_manager' (f03f1731-e993-44b6-a14a-f28116acec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3300e22c-e062-49e8-8efe-43c3a4493502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3300e22c-e062-49e8-8efe-43c3a4493502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1715364137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299c6371-1bc9-492f-a75c-d7094027712c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc2260af333409eae8c6c08ff79ff16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:29Z,use_quota=True,user_id='276e5c26353f4de882bdd52bc0c735e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842a0068-98fa-4b70-8ee6-d4f1b235c5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842a0068-98fa-4b70-8ee6-d4f1b235c5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034e71bd-36f4-4706-a235-4f681cfdaf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034e71bd-36f4-4706-a235-4f681cfdaf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '299c6371-1bc9-492f-a75c-d7094027712c', 'volume_name': 'volume-299c6371-1bc9-492f-a75c-d7094027712c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b02b85-84d1-4ee8-962a-f036280589fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b02b85-84d1-4ee8-962a-f036280589fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e943e5-d6e0-4228-a1f6-b4c5f7b00faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Volume 299c6371-1bc9-492f-a75c-d7094027712c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-299c6371-1bc9-492f-a75c-d7094027712c', 'volume_size': 1} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1715364137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299c6371-1bc9-492f-a75c-d7094027712c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc2260af333409eae8c6c08ff79ff16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:29Z,use_quota=True,user_id='276e5c26353f4de882bdd52bc0c735e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Creating volume 299c6371-1bc9-492f-a75c-d7094027712c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:29 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "cinder-6e89bcd2-7901-4d51-b0d9-f7674717c4b6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:29 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c 1073741824 Sep 04 06:04:29 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-6e89bcd2-7901-4d51-b0d9-f7674717c4b6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:29 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "cinder-quobyte-6e89bcd2-7901-4d51-b0d9-f7674717c4b6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:29 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493 Sep 04 06:04:29 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-quobyte-6e89bcd2-7901-4d51-b0d9-f7674717c4b6" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed7031d-1254-44fe-a0d6-327a586fa77f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:29 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6 Sep 04 06:04:29 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:29 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f18a0c32-14da-457f-8027-970ac4765493" returned: 0 in 0.268s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-quobyte-f18a0c32-14da-457f-8027-970ac4765493" released by "delete_volume" :: held 0.737s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Created reservations ['ee8b0fef-7ac8-499c-a3b5-8ee22494f8b5', '21a4a6fb-42eb-4672-a57c-a87bd07df29c', 'c4992f39-7041-47ab-b2b0-a4da3408c143', '5c60a4c0-2b0f-4401-b2cc-b2c769265563'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:29 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c 1073741824" returned: 0 in 0.524s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:29 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:29 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:29 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6" returned: 0 in 0.430s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:30 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c Sep 04 06:04:30 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:30 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6 Sep 04 06:04:30 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:30 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Deleted volume successfully. Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4296df4f-1340-416d-a909-1d503c8681d0 tempest-VolumesSnapshotListTestJSON-1911571974 None] Lock "cinder-f18a0c32-14da-457f-8027-970ac4765493-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:30 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c" returned: 0 in 0.448s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e943e5-d6e0-4228-a1f6-b4c5f7b00faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-299c6371-1bc9-492f-a75c-d7094027712c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c02fdf-e411-41b7-8bb4-eb6cd4fa0613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:30 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6e89bcd2-7901-4d51-b0d9-f7674717c4b6" returned: 0 in 0.499s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Volume volume-299c6371-1bc9-492f-a75c-d7094027712c (299c6371-1bc9-492f-a75c-d7094027712c): created successfully Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c02fdf-e411-41b7-8bb4-eb6cd4fa0613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Flow 'volume_create_manager' (f03f1731-e993-44b6-a14a-f28116acec52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-quobyte-6e89bcd2-7901-4d51-b0d9-f7674717c4b6" released by "delete_volume" :: held 1.012s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-80abce08-f04c-4200-b2a8-17ca06b7c814 tempest-SnapshotMetadataTestJSON-1972976685 None] Created volume successfully. Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Created reservations ['0becc405-0118-4db8-917a-e00459bdb61a', '044a16c4-e611-46ef-b70d-c655e36e2c35', '3c761480-8e2f-43de-9606-a365b0cab5d2', '422e6753-1b25-41b4-92a0-d9dcd8e0a280'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Flow 'volume_create_manager' (f055c327-3042-4557-bede-931288ad58e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa1fd3d-c050-421d-a495-df821f271035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa1fd3d-c050-421d-a495-df821f271035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-984775058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b28f69-b7bb-444a-a53d-73f683b58df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35ed305c3ca47f9afba72b02c36ad94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:31Z,use_quota=True,user_id='7d4d2795ffb340fa97c09e291b88a30b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:30 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:30 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9530486f-4f80-44f0-ace6-1ca5cd8871de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9530486f-4f80-44f0-ace6-1ca5cd8871de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f3120d-0406-47e8-a131-314fe093d464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f3120d-0406-47e8-a131-314fe093d464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b28f69-b7bb-444a-a53d-73f683b58df6', 'volume_name': 'volume-52b28f69-b7bb-444a-a53d-73f683b58df6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f55d5d-2f87-4108-84a8-61a7cf52ac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f55d5d-2f87-4108-84a8-61a7cf52ac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10be090-382c-47ed-95ab-bb92aee4ec08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Volume 52b28f69-b7bb-444a-a53d-73f683b58df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b28f69-b7bb-444a-a53d-73f683b58df6', 'volume_size': 1} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-984775058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b28f69-b7bb-444a-a53d-73f683b58df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35ed305c3ca47f9afba72b02c36ad94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:31Z,use_quota=True,user_id='7d4d2795ffb340fa97c09e291b88a30b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Creating volume 52b28f69-b7bb-444a-a53d-73f683b58df6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:30 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-52b28f69-b7bb-444a-a53d-73f683b58df6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:30 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-52b28f69-b7bb-444a-a53d-73f683b58df6 1073741824 Sep 04 06:04:30 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:31 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.260s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Deleted volume successfully. Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b61f4af-39b8-4900-97c4-c78e0db57d00 tempest-CreateVolumesFromImageTest-1022388393 None] Lock "cinder-6e89bcd2-7901-4d51-b0d9-f7674717c4b6-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:31 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-52b28f69-b7bb-444a-a53d-73f683b58df6 1073741824" returned: 0 in 0.536s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-52b28f69-b7bb-444a-a53d-73f683b58df6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:31 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-52b28f69-b7bb-444a-a53d-73f683b58df6 Sep 04 06:04:31 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:31 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-52b28f69-b7bb-444a-a53d-73f683b58df6" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] Creating offline snapshot 0bff51bd-b723-4539-b49b-7d97b46624f0 of volume 299c6371-1bc9-492f-a75c-d7094027712c {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10be090-382c-47ed-95ab-bb92aee4ec08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b28f69-b7bb-444a-a53d-73f683b58df6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f2c36a-596d-437a-bb2c-f495fc44c825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c224202a-f93b-4e25-bac6-fa0bdcca37e4]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Volume volume-52b28f69-b7bb-444a-a53d-73f683b58df6 (52b28f69-b7bb-444a-a53d-73f683b58df6): created successfully Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f2c36a-596d-437a-bb2c-f495fc44c825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Flow 'volume_create_manager' (f055c327-3042-4557-bede-931288ad58e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2028613c-1498-46cd-862c-e4a102c568b4 tempest-VolumesListAdminTestJSON-1420074374 None] Created volume successfully. Sep 04 06:04:31 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c Sep 04 06:04:31 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:32 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c" returned: 0 in 0.402s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:32 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 1G Sep 04 06:04:32 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:32 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 1G" returned: 0 in 0.554s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-299c6371-1bc9-492f-a75c-d7094027712c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:32 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-299c6371-1bc9-492f-a75c-d7094027712c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 Sep 04 06:04:32 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:33 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-299c6371-1bc9-492f-a75c-d7094027712c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0" returned: 0 in 0.394s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:33 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 is being set with open permissions: ugo+rw Sep 04 06:04:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:33 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 Sep 04 06:04:33 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:33 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0" returned: 0 in 0.413s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:33 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.info Sep 04 06:04:33 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:33 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Flow 'volume_create_manager' (3f6c2452-2392-4487-8dbe-8b9d383158a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcacd88e-bca0-4d4f-8ed0-b899865507bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcacd88e-bca0-4d4f-8ed0-b899865507bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7a1eed-960a-4a4c-a412-fd4c742439b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be2908b847424001973bfbb9113d81ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:34Z,use_quota=True,user_id='c4f05728e24f495ca5f4ae1784a4cb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb44614-31f4-46f3-bfc5-35976e34f865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb44614-31f4-46f3-bfc5-35976e34f865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b37f62-7863-4105-9ded-23287d6cb2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:34 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b37f62-7863-4105-9ded-23287d6cb2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7a1eed-960a-4a4c-a412-fd4c742439b0', 'volume_name': 'volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981197cb-1d74-4cfb-8ab8-8fa3259704c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981197cb-1d74-4cfb-8ab8-8fa3259704c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7dcb69-3faa-421d-af4b-b0b3fd59123f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Volume 5d7a1eed-960a-4a4c-a412-fd4c742439b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0', 'volume_size': 1} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.info" returned: 0 in 0.412s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:34 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.info is being set with open permissions: ugo+rw Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:34 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.info Sep 04 06:04:34 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:34 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.info" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.608s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.323s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7a1eed-960a-4a4c-a412-fd4c742439b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be2908b847424001973bfbb9113d81ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:34Z,use_quota=True,user_id='c4f05728e24f495ca5f4ae1784a4cb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Creating volume 5d7a1eed-960a-4a4c-a412-fd4c742439b0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:34 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:34 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0 1073741824 Sep 04 06:04:34 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-34003080-6a75-493e-adf9-4e3e7c1f4a35 tempest-SnapshotMetadataTestJSON-1972976685 None] Create snapshot completed successfully Sep 04 06:04:35 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0 1073741824" returned: 0 in 0.637s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:35 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0 Sep 04 06:04:35 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:35 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7dcb69-3faa-421d-af4b-b0b3fd59123f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f333a58-0ae9-47be-ac2f-ddd115746b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Volume volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0 (5d7a1eed-960a-4a4c-a412-fd4c742439b0): created successfully Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f333a58-0ae9-47be-ac2f-ddd115746b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Flow 'volume_create_manager' (3f6c2452-2392-4487-8dbe-8b9d383158a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-467d63c5-1b4b-447c-a0f6-c8e0897c4de0 tempest-VolumesListAdminTestJSON-1000245420 None] Created volume successfully. Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Flow 'volume_create_manager' (27083117-cb45-40e8-b345-4433a26802f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6801ef78-b890-4d6e-bc4a-dc48c0fb762f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6801ef78-b890-4d6e-bc4a-dc48c0fb762f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1626265412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51c63f0-b322-4c08-a9d3-abc2e9eda003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe9b51429b14710808e7ff633a1e925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:36Z,use_quota=True,user_id='80225d4442c74aefa4d8a344b603e5ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b63815-6bdb-4104-992e-36d266733b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b63815-6bdb-4104-992e-36d266733b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9cd2b0e-7bba-4c44-ad27-457996672617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9cd2b0e-7bba-4c44-ad27-457996672617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51c63f0-b322-4c08-a9d3-abc2e9eda003', 'volume_name': 'volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc216cc-a7f3-4f9a-9dea-c1053fddaa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc216cc-a7f3-4f9a-9dea-c1053fddaa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9f6299-5641-49a9-939d-e2f2976a8c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Volume c51c63f0-b322-4c08-a9d3-abc2e9eda003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003', 'volume_size': 1} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1626265412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51c63f0-b322-4c08-a9d3-abc2e9eda003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe9b51429b14710808e7ff633a1e925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:36Z,use_quota=True,user_id='80225d4442c74aefa4d8a344b603e5ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Creating volume c51c63f0-b322-4c08-a9d3-abc2e9eda003 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:35 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:35 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 1073741824 Sep 04 06:04:35 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Acquiring lock "cinder-0bff51bd-b723-4539-b49b-7d97b46624f0-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "cinder-0bff51bd-b723-4539-b49b-7d97b46624f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Acquiring lock "cinder-quobyte-299c6371-1bc9-492f-a75c-d7094027712c" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "cinder-quobyte-299c6371-1bc9-492f-a75c-d7094027712c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Acquiring lock "cinder-quobyte-0bff51bd-b723-4539-b49b-7d97b46624f0" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "cinder-quobyte-0bff51bd-b723-4539-b49b-7d97b46624f0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Deleting offline snapshot 0bff51bd-b723-4539-b49b-7d97b46624f0 of volume 299c6371-1bc9-492f-a75c-d7094027712c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] snapshot_file for this snap is: volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc25a136-9c9d-4f65-af5e-74c2a5108ca5]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Acquiring lock "cinder-5d7a1eed-960a-4a4c-a412-fd4c742439b0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:36 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 Sep 04 06:04:36 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Lock "cinder-5d7a1eed-960a-4a4c-a412-fd4c742439b0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Acquiring lock "cinder-quobyte-5d7a1eed-960a-4a4c-a412-fd4c742439b0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Lock "cinder-quobyte-5d7a1eed-960a-4a4c-a412-fd4c742439b0" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56b6c00-ffd1-4933-97d7-d64da9688ba9]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "cinder-52b28f69-b7bb-444a-a53d-73f683b58df6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Lock "cinder-52b28f69-b7bb-444a-a53d-73f683b58df6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "cinder-quobyte-52b28f69-b7bb-444a-a53d-73f683b58df6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Lock "cinder-quobyte-52b28f69-b7bb-444a-a53d-73f683b58df6" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:36 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 1073741824" returned: 0 in 0.684s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3c06ce-6d66-4f8d-a53f-b906d36261b3]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-52b28f69-b7bb-444a-a53d-73f683b58df6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:36 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0 Sep 04 06:04:36 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:36 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 Sep 04 06:04:36 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:36 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-52b28f69-b7bb-444a-a53d-73f683b58df6 Sep 04 06:04:36 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:36 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0" returned: 0 in 0.676s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-299c6371-1bc9-492f-a75c-d7094027712c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4a3998-058b-44c9-83c9-46dfe213393b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:36 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0" returned: 0 in 0.621s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:36 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c Sep 04 06:04:36 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:36 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:36 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0 Sep 04 06:04:36 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9f6299-5641-49a9-939d-e2f2976a8c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e055cb-0991-46e8-9fab-9aa787853b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Volume volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 (c51c63f0-b322-4c08-a9d3-abc2e9eda003): created successfully Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e055cb-0991-46e8-9fab-9aa787853b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Flow 'volume_create_manager' (27083117-cb45-40e8-b345-4433a26802f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d25fa506-9672-4978-9edc-3cf2d009b591 tempest-VolumeDependencyTests-2093481831 None] Created volume successfully. Sep 04 06:04:37 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-52b28f69-b7bb-444a-a53d-73f683b58df6" returned: 0 in 0.562s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-52b28f69-b7bb-444a-a53d-73f683b58df6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:37 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-52b28f69-b7bb-444a-a53d-73f683b58df6 Sep 04 06:04:37 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:37 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c" returned: 0 in 0.451s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:37 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 Sep 04 06:04:37 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:37 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5d7a1eed-960a-4a4c-a412-fd4c742439b0" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Lock "cinder-quobyte-5d7a1eed-960a-4a4c-a412-fd4c742439b0" released by "delete_volume" :: held 1.011s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Created reservations ['adf0d446-2f29-4b38-ac42-65fe6b903776', '88eb39a6-8c54-41ae-b292-bd1df30356ae', 'f6f5cd8e-a659-4211-81a0-e13a3d4efbd5', 'af15ee25-768e-4f43-97e6-5524729fa4cd'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:37 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-52b28f69-b7bb-444a-a53d-73f683b58df6" returned: 0 in 0.293s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Lock "cinder-quobyte-52b28f69-b7bb-444a-a53d-73f683b58df6" released by "delete_volume" :: held 0.947s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Created reservations ['38b4948d-4c61-438a-8789-b73f1b33aa1a', 'cc952739-8d5b-4e72-86e0-c967bd9de5f7', '9da3e00f-e582-447a-a6c6-34942be954dc', '692932a5-130d-47c7-bd97-bc6176ce0a16'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:37 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:37 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:37 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:37 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:37 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0" returned: 0 in 0.484s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:37 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0 Sep 04 06:04:37 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:37 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.505s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Deleted volume successfully. Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a5659524-e601-4a50-a1c0-0b7c3875e1b9 tempest-VolumesListAdminTestJSON-1000245420 None] Lock "cinder-5d7a1eed-960a-4a4c-a412-fd4c742439b0-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:37 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.389s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Deleted volume successfully. Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27c33811-5b0b-47fb-81f5-13b27d28b80c tempest-VolumesListAdminTestJSON-1420074374 None] Lock "cinder-52b28f69-b7bb-444a-a53d-73f683b58df6-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:38 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c.0bff51bd-b723-4539-b49b-7d97b46624f0" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "cinder-quobyte-0bff51bd-b723-4539-b49b-7d97b46624f0" released by "_delete_snapshot" :: held 2.186s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] Creating offline snapshot 10b780e3-33b0-46a9-8ab3-4feddf28a0d6 of volume c51c63f0-b322-4c08-a9d3-abc2e9eda003 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "cinder-quobyte-299c6371-1bc9-492f-a75c-d7094027712c" released by "delete_snapshot" :: held 2.248s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d81e5c-46d8-4789-ab06-0e0f3d50833e]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Created reservations ['56d482d2-a630-446e-b077-e05daf58fd18', '0ba8bf7c-fb09-4672-9325-0eae2cae62fa', 'd921dfa4-eec3-462a-a1f7-affbb7d58794', '03d8560f-b0d6-4c65-9738-dc88a3de0545'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:38 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 Sep 04 06:04:38 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Delete snapshot completed successfully. Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d7af6f54-cf6c-47a6-8e2b-281e92741ce3 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "cinder-0bff51bd-b723-4539-b49b-7d97b46624f0-delete_snapshot" released by "delete_snapshot" :: held 2.439s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:38 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003" returned: 0 in 0.395s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:38 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 1G Sep 04 06:04:38 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "cinder-f7aab1be-c0a0-43d7-a434-20737e867cff-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "cinder-f7aab1be-c0a0-43d7-a434-20737e867cff-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "cinder-quobyte-f7aab1be-c0a0-43d7-a434-20737e867cff" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "cinder-quobyte-f7aab1be-c0a0-43d7-a434-20737e867cff" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d834dd-48da-41e1-827c-03fc39f65f25]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f7aab1be-c0a0-43d7-a434-20737e867cff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:38 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f7aab1be-c0a0-43d7-a434-20737e867cff Sep 04 06:04:38 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:39 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 1G" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:39 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 Sep 04 06:04:39 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Acquiring lock "cinder-299c6371-1bc9-492f-a75c-d7094027712c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:39 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f7aab1be-c0a0-43d7-a434-20737e867cff" returned: 0 in 0.436s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f7aab1be-c0a0-43d7-a434-20737e867cff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "cinder-299c6371-1bc9-492f-a75c-d7094027712c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:39 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f7aab1be-c0a0-43d7-a434-20737e867cff Sep 04 06:04:39 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Acquiring lock "cinder-quobyte-299c6371-1bc9-492f-a75c-d7094027712c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "cinder-quobyte-299c6371-1bc9-492f-a75c-d7094027712c" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1940ae5f-6954-434f-9e86-ae9d81feac1a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:39 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6" returned: 0 in 0.475s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:39 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 is being set with open permissions: ugo+rw Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:39 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 Sep 04 06:04:39 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:39 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c Sep 04 06:04:39 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:39 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f7aab1be-c0a0-43d7-a434-20737e867cff" returned: 0 in 0.470s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "cinder-quobyte-f7aab1be-c0a0-43d7-a434-20737e867cff" released by "delete_volume" :: held 0.964s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Created reservations ['f31aaed6-bde0-465f-be8d-943b85edea31', '7b0a473c-8124-4597-950b-72ddfa93bb32', 'bda89a64-b855-42a1-9b74-66027631b909', '7139ed1a-3801-446e-980a-72e2e1685288'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:39 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:40 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:40 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:40 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.info Sep 04 06:04:40 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:40 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c" returned: 0 in 0.645s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:40 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c Sep 04 06:04:40 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:40 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.info" returned: 0 in 0.288s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:40 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.info is being set with open permissions: ugo+rw Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:40 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:40 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.info Sep 04 06:04:40 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Deleted volume successfully. Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-10b1692e-c5e1-4080-87c6-3e65148d39e6 tempest-VolumesListAdminTestJSON-1420074374 None] Lock "cinder-f7aab1be-c0a0-43d7-a434-20737e867cff-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:40 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-299c6371-1bc9-492f-a75c-d7094027712c" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "cinder-quobyte-299c6371-1bc9-492f-a75c-d7094027712c" released by "delete_volume" :: held 1.075s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Created reservations ['7f7e7bb9-94f8-4828-a24e-b20ebdb8398f', 'c6bf6f25-24cf-4462-9f49-e3031ec7102f', 'bf8b89f3-8fc3-4dc8-b571-e32a639cc97c', 'b45d1aff-896b-43d6-8d7f-1ebaf80a7445'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:40 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.info" returned: 0 in 0.342s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:40 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:40 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a8299df7-62c7-46c2-b348-07045698c125 tempest-VolumeDependencyTests-2093481831 None] Create snapshot completed successfully Sep 04 06:04:40 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:40 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Deleted volume successfully. Sep 04 06:04:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8b0f32f-3203-4264-8798-f689cceaf5f2 tempest-SnapshotMetadataTestJSON-1972976685 None] Lock "cinder-299c6371-1bc9-492f-a75c-d7094027712c-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "cinder-58958271-8152-4b89-9272-cd813770f67f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Lock "cinder-58958271-8152-4b89-9272-cd813770f67f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:41 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=184,cinder:UPDATE=249,cinder:INSERT=51,cinder:DELETE=13 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:04:41 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=188,cinder:UPDATE=243,cinder:DELETE=30,cinder:INSERT=68 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:04:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "cinder-quobyte-58958271-8152-4b89-9272-cd813770f67f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Lock "cinder-quobyte-58958271-8152-4b89-9272-cd813770f67f" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f321c4-8e48-4cd5-8f56-f8b63e28d4e4]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58958271-8152-4b89-9272-cd813770f67f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:41 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58958271-8152-4b89-9272-cd813770f67f Sep 04 06:04:41 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:41 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58958271-8152-4b89-9272-cd813770f67f" returned: 0 in 0.493s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58958271-8152-4b89-9272-cd813770f67f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:41 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58958271-8152-4b89-9272-cd813770f67f Sep 04 06:04:41 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:42 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58958271-8152-4b89-9272-cd813770f67f" returned: 0 in 0.410s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Flow 'volume_create_manager' (342eb5af-1c2b-419c-a727-e69f800c9f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3122de-8a3a-461c-986f-5ab2543f88bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Lock "cinder-quobyte-58958271-8152-4b89-9272-cd813770f67f" released by "delete_volume" :: held 0.994s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3122de-8a3a-461c-986f-5ab2543f88bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2108657393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4094f574-645d-44b6-bf09-83582e951219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe9b51429b14710808e7ff633a1e925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10b780e3-33b0-46a9-8ab3-4feddf28a0d6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:42Z,use_quota=True,user_id='80225d4442c74aefa4d8a344b603e5ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b41343-5c15-4c46-a98c-415213c65964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b41343-5c15-4c46-a98c-415213c65964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed42bc22-6a4b-461b-8ec4-994c41040de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed42bc22-6a4b-461b-8ec4-994c41040de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4094f574-645d-44b6-bf09-83582e951219', 'volume_name': 'volume-4094f574-645d-44b6-bf09-83582e951219', 'volume_size': 1, 'snapshot_id': '10b780e3-33b0-46a9-8ab3-4feddf28a0d6'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b606481f-6f07-42ab-ab99-ef599053d90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b606481f-6f07-42ab-ab99-ef599053d90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe3a662-c78e-4cc0-834f-4bcb6702f80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Volume 4094f574-645d-44b6-bf09-83582e951219: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4094f574-645d-44b6-bf09-83582e951219', 'volume_size': 1, 'snapshot_id': '10b780e3-33b0-46a9-8ab3-4feddf28a0d6'} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "cinder-quobyte-10b780e3-33b0-46a9-8ab3-4feddf28a0d6-4094f574-645d-44b6-bf09-83582e951219" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-quobyte-10b780e3-33b0-46a9-8ab3-4feddf28a0d6-4094f574-645d-44b6-bf09-83582e951219" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Creating volume 4094f574-645d-44b6-bf09-83582e951219 from snapshot 10b780e3-33b0-46a9-8ab3-4feddf28a0d6 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "cinder-quobyte-4094f574-645d-44b6-bf09-83582e951219" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-quobyte-4094f574-645d-44b6-bf09-83582e951219" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] snapshot: 10b780e3-33b0-46a9-8ab3-4feddf28a0d6, volume: 4094f574-645d-44b6-bf09-83582e951219, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Created reservations ['b6de215a-763d-4e9c-a4c4-b1092de8fb3b', '5f5b6172-8df7-4342-9c60-5402d666eb4a', '6085243b-7b89-4339-bc30-5b850517ee2d', 'a24cb0d2-21be-4764-b6d5-009886453dbf'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[077a5dd3-5b32-4be6-bf12-46de2c039094]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:42 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:42 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:42 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 Sep 04 06:04:42 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:42 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Deleted volume successfully. Sep 04 06:04:42 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6" returned: 0 in 0.486s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-803ab6f4-f9d7-445c-8be9-df788b28519e tempest-VolumesListAdminTestJSON-1420074374 None] Lock "cinder-58958271-8152-4b89-9272-cd813770f67f-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec576b9-04d8-4ec5-a65c-5ec1416ba373]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:43 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 Sep 04 06:04:43 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:43 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003" returned: 0 in 0.428s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] will copy from snapshot at /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 06:04:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 06:04:43 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Path /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 06:04:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:43 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219 Sep 04 06:04:43 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:49 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219" returned: 0 in 6.006s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:49 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:04:49 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Converted 1024.00 MB image at 170.42 MB/s Sep 04 06:04:49 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219 is being set with open permissions: ugo+rw Sep 04 06:04:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:49 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219 Sep 04 06:04:49 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:49 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219" returned: 0 in 0.451s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-quobyte-4094f574-645d-44b6-bf09-83582e951219" released by "_copy_volume_from_snapshot" :: held 7.486s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-quobyte-10b780e3-33b0-46a9-8ab3-4feddf28a0d6-4094f574-645d-44b6-bf09-83582e951219" released by "_create_volume_from_snapshot" :: held 7.589s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.629s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe3a662-c78e-4cc0-834f-4bcb6702f80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4094f574-645d-44b6-bf09-83582e951219', 'volume_size': 1, 'snapshot_id': '10b780e3-33b0-46a9-8ab3-4feddf28a0d6'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f840f47-5e05-4066-b9e1-de0602d6b9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:50 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Volume volume-4094f574-645d-44b6-bf09-83582e951219 (4094f574-645d-44b6-bf09-83582e951219): created successfully Sep 04 06:04:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f840f47-5e05-4066-b9e1-de0602d6b9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Flow 'volume_create_manager' (342eb5af-1c2b-419c-a727-e69f800c9f59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3559ddfc-ebc2-4980-a66d-a2abe462f087 tempest-VolumeDependencyTests-2093481831 None] Created volume successfully. Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "cinder-10b780e3-33b0-46a9-8ab3-4feddf28a0d6-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-10b780e3-33b0-46a9-8ab3-4feddf28a0d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "cinder-quobyte-c51c63f0-b322-4c08-a9d3-abc2e9eda003" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-quobyte-c51c63f0-b322-4c08-a9d3-abc2e9eda003" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "cinder-quobyte-10b780e3-33b0-46a9-8ab3-4feddf28a0d6" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-quobyte-10b780e3-33b0-46a9-8ab3-4feddf28a0d6" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Deleting offline snapshot 10b780e3-33b0-46a9-8ab3-4feddf28a0d6 of volume c51c63f0-b322-4c08-a9d3-abc2e9eda003 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] snapshot_file for this snap is: volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4de3b9-15bf-4da4-9f2d-1c290facd8f5]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:51 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 Sep 04 06:04:51 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Flow 'volume_create_manager' (1cf5e824-d919-4f5b-9ed4-b2dbea881099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9efe4e8-6613-4837-a2d2-3f08a114507e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9efe4e8-6613-4837-a2d2-3f08a114507e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1802412363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e379636e-c7ae-428e-bbab-6c6f70c20882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa599d01ff1460885349367e030b186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:52Z,use_quota=True,user_id='99fbaa15a03c461192c0a5c9acaf622a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385e36cb-2dca-4958-95c7-cc26be78481d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385e36cb-2dca-4958-95c7-cc26be78481d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a17e86-f631-4751-a774-6123856e8471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a17e86-f631-4751-a774-6123856e8471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e379636e-c7ae-428e-bbab-6c6f70c20882', 'volume_name': 'volume-e379636e-c7ae-428e-bbab-6c6f70c20882', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d73ce4-975d-4475-b27e-ca5cf3c6f317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d73ce4-975d-4475-b27e-ca5cf3c6f317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f431c4-79c4-4545-a91a-29c3202b1a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Volume e379636e-c7ae-428e-bbab-6c6f70c20882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e379636e-c7ae-428e-bbab-6c6f70c20882', 'volume_size': 1} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1802412363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e379636e-c7ae-428e-bbab-6c6f70c20882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa599d01ff1460885349367e030b186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:52Z,use_quota=True,user_id='99fbaa15a03c461192c0a5c9acaf622a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Creating volume e379636e-c7ae-428e-bbab-6c6f70c20882 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:51 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:51 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e379636e-c7ae-428e-bbab-6c6f70c20882 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6" returned: 0 in 0.635s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:04:51 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e379636e-c7ae-428e-bbab-6c6f70c20882 1073741824 Sep 04 06:04:51 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8471d7a-5c2f-41dc-8a9d-fe24f61077c2]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:52 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 Sep 04 06:04:52 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:52 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e379636e-c7ae-428e-bbab-6c6f70c20882 1073741824" returned: 0 in 0.639s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e379636e-c7ae-428e-bbab-6c6f70c20882 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:52 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e379636e-c7ae-428e-bbab-6c6f70c20882 Sep 04 06:04:52 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:52 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003" returned: 0 in 0.738s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:52 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 Sep 04 06:04:52 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:52 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e379636e-c7ae-428e-bbab-6c6f70c20882" returned: 0 in 0.319s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:04:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f431c4-79c4-4545-a91a-29c3202b1a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e379636e-c7ae-428e-bbab-6c6f70c20882', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648c925d-c95c-4027-9560-a63b123af222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:52 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Volume volume-e379636e-c7ae-428e-bbab-6c6f70c20882 (e379636e-c7ae-428e-bbab-6c6f70c20882): created successfully Sep 04 06:04:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648c925d-c95c-4027-9560-a63b123af222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Flow 'volume_create_manager' (1cf5e824-d919-4f5b-9ed4-b2dbea881099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4ee2c508-dda0-4b8a-96a3-bef90027954f tempest-VolumesTransfersTest-1394357886 None] Created volume successfully. Sep 04 06:04:53 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6" returned: 0 in 0.457s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:53 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6 Sep 04 06:04:53 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:53 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003.10b780e3-33b0-46a9-8ab3-4feddf28a0d6" returned: 0 in 0.266s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-quobyte-10b780e3-33b0-46a9-8ab3-4feddf28a0d6" released by "_delete_snapshot" :: held 2.267s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-quobyte-c51c63f0-b322-4c08-a9d3-abc2e9eda003" released by "delete_snapshot" :: held 2.311s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:53 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Created reservations ['fa21f150-c6a7-4ad9-a207-e6b37f6956e3', 'cfad245b-3b0a-48e5-b74d-1641111e376e', 'f9ef4985-960b-4bfe-9b8e-a95c780094f8', 'f95dca4c-770d-4f6e-934f-8b4cd24934fb'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Delete snapshot completed successfully. Sep 04 06:04:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c9044602-4058-4542-948e-f787cce7f7db tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-10b780e3-33b0-46a9-8ab3-4feddf28a0d6-delete_snapshot" released by "delete_snapshot" :: held 2.515s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "cinder-c51c63f0-b322-4c08-a9d3-abc2e9eda003-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-c51c63f0-b322-4c08-a9d3-abc2e9eda003-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "cinder-quobyte-c51c63f0-b322-4c08-a9d3-abc2e9eda003" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-quobyte-c51c63f0-b322-4c08-a9d3-abc2e9eda003" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3979dc55-2b3b-4428-bf88-b48f175dfe81]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:54 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 Sep 04 06:04:54 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e74f6540-96de-4bc3-985e-8507383249d8 tempest-VolumesTransfersTest-275199212 None] Transfer volume completed successfully. Sep 04 06:04:55 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:55 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003 Sep 04 06:04:55 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:55 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c51c63f0-b322-4c08-a9d3-abc2e9eda003" returned: 0 in 0.290s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-quobyte-c51c63f0-b322-4c08-a9d3-abc2e9eda003" released by "delete_volume" :: held 0.866s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Created reservations ['89c9e200-ce8c-4834-8977-0d967d7e75b1', '1e11113a-a6a0-41d3-9c12-f90cb3ce66d9', '6f85c70a-b392-4930-8c86-18b3a6159a5d', 'd544d904-044d-4d47-a80e-a638d4a20bdd'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:55 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:55 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "cinder-4094f574-645d-44b6-bf09-83582e951219-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-4094f574-645d-44b6-bf09-83582e951219-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "cinder-quobyte-4094f574-645d-44b6-bf09-83582e951219" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-quobyte-4094f574-645d-44b6-bf09-83582e951219" acquired by "delete_volume" :: waited 0.061s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Acquiring lock "cinder-e379636e-c7ae-428e-bbab-6c6f70c20882-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b4bbae-e2c2-4e29-bf97-dc5cfd24e6bb]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Lock "cinder-e379636e-c7ae-428e-bbab-6c6f70c20882-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Acquiring lock "cinder-quobyte-e379636e-c7ae-428e-bbab-6c6f70c20882" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Lock "cinder-quobyte-e379636e-c7ae-428e-bbab-6c6f70c20882" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:04:56 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.638s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Deleted volume successfully. Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68e4f94-b8d8-46ae-b3b6-20ae8d0160cb]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e379636e-c7ae-428e-bbab-6c6f70c20882 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c94f5a86-cd64-4bad-a79f-971d82cd29f9 tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-c51c63f0-b322-4c08-a9d3-abc2e9eda003-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:56 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219 Sep 04 06:04:56 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:56 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e379636e-c7ae-428e-bbab-6c6f70c20882 Sep 04 06:04:56 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:56 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e379636e-c7ae-428e-bbab-6c6f70c20882" returned: 0 in 0.473s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e379636e-c7ae-428e-bbab-6c6f70c20882 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:56 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e379636e-c7ae-428e-bbab-6c6f70c20882 Sep 04 06:04:56 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:56 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219" returned: 0 in 0.719s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:56 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219 Sep 04 06:04:56 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:57 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e379636e-c7ae-428e-bbab-6c6f70c20882" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Lock "cinder-quobyte-e379636e-c7ae-428e-bbab-6c6f70c20882" released by "delete_volume" :: held 0.914s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:57 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4094f574-645d-44b6-bf09-83582e951219" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-quobyte-4094f574-645d-44b6-bf09-83582e951219" released by "delete_volume" :: held 1.282s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Created reservations ['633adbbd-ba4c-4015-a60f-c72351528913', 'f74894ad-c1d7-48c6-8c9d-605771a8af5c', '7405b719-b8e6-4028-a6a0-e8c8ba79bae4', '33515eae-d8a7-4ec1-8903-6a3cd47a495b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Created reservations ['eae99ac8-07ff-4cb3-a211-8c212298c879', '58d96e1d-d1ef-4f9d-bf63-34541161af87', '0c791692-f809-42e1-8a82-0702671b22e6', '46c21d44-93e2-49ae-b71a-a53c51f5a0b2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:57 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:57 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:57 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:04:57 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:57 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Deleted volume successfully. Sep 04 06:04:57 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.301s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:04:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Deleted volume successfully. Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69531ede-7123-40c4-ae6c-136f839329f2 tempest-VolumesTransfersTest-802403753 None] Lock "cinder-e379636e-c7ae-428e-bbab-6c6f70c20882-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8a217b48-21b0-4db9-b173-4cfc2bb6aa95 tempest-VolumeDependencyTests-2093481831 None] Lock "cinder-4094f574-645d-44b6-bf09-83582e951219-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Flow 'volume_create_manager' (bb62fb16-a249-42e0-865f-11dec1d3e8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3631be6-8c16-4f64-a9fd-f59d4a9967be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3631be6-8c16-4f64-a9fd-f59d4a9967be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2092393444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678d4452-0326-4b9e-bce8-13493abbbb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa599d01ff1460885349367e030b186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:59Z,use_quota=True,user_id='99fbaa15a03c461192c0a5c9acaf622a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdd68a5-1b7f-424e-a40b-578aa6263fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdd68a5-1b7f-424e-a40b-578aa6263fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdd035f-234d-45d9-b6a4-95f44b13b96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdd035f-234d-45d9-b6a4-95f44b13b96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '678d4452-0326-4b9e-bce8-13493abbbb36', 'volume_name': 'volume-678d4452-0326-4b9e-bce8-13493abbbb36', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbea0fa5-d007-428f-b943-1c55a3469e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbea0fa5-d007-428f-b943-1c55a3469e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2d893b-995f-4b0d-aa4d-6b23543b80eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:04:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Volume 678d4452-0326-4b9e-bce8-13493abbbb36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-678d4452-0326-4b9e-bce8-13493abbbb36', 'volume_size': 1} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2092393444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678d4452-0326-4b9e-bce8-13493abbbb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa599d01ff1460885349367e030b186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:59Z,use_quota=True,user_id='99fbaa15a03c461192c0a5c9acaf622a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Creating volume 678d4452-0326-4b9e-bce8-13493abbbb36 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:04:59 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-678d4452-0326-4b9e-bce8-13493abbbb36 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:04:59 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-678d4452-0326-4b9e-bce8-13493abbbb36 1073741824 Sep 04 06:04:59 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:04:59 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-678d4452-0326-4b9e-bce8-13493abbbb36 1073741824" returned: 0 in 0.641s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:04:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-678d4452-0326-4b9e-bce8-13493abbbb36 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:00 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-678d4452-0326-4b9e-bce8-13493abbbb36 Sep 04 06:05:00 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:00 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-678d4452-0326-4b9e-bce8-13493abbbb36" returned: 0 in 0.429s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:05:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2d893b-995f-4b0d-aa4d-6b23543b80eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-678d4452-0326-4b9e-bce8-13493abbbb36', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19404d04-b6e6-4b1a-a298-737f161cbbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Volume volume-678d4452-0326-4b9e-bce8-13493abbbb36 (678d4452-0326-4b9e-bce8-13493abbbb36): created successfully Sep 04 06:05:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19404d04-b6e6-4b1a-a298-737f161cbbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Flow 'volume_create_manager' (bb62fb16-a249-42e0-865f-11dec1d3e8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1128c4f8-ffb5-4d0d-ad55-10381d5a7139 tempest-VolumesTransfersTest-1394357886 None] Created volume successfully. Sep 04 06:05:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Acquiring lock "cinder-678d4452-0326-4b9e-bce8-13493abbbb36-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Lock "cinder-678d4452-0326-4b9e-bce8-13493abbbb36-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Acquiring lock "cinder-quobyte-678d4452-0326-4b9e-bce8-13493abbbb36" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Lock "cinder-quobyte-678d4452-0326-4b9e-bce8-13493abbbb36" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c01d52-e16e-4152-9a88-08d2028bd859]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-678d4452-0326-4b9e-bce8-13493abbbb36 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:01 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-678d4452-0326-4b9e-bce8-13493abbbb36 Sep 04 06:05:01 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Flow 'volume_create_manager' (ea30b307-06b1-42ba-9bad-f26dd6286d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acb4391-6d46-46c6-a7c1-6e1078ff47cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:02 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acb4391-6d46-46c6-a7c1-6e1078ff47cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-636065528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6088ed29-70b7-4a34-931e-12d83d1317b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5b05e1153740d6bd9b4007ef00067d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:02Z,use_quota=True,user_id='bc785c405fee49f3ae4459313cf90c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feeb7d15-6f7d-4018-978f-43692706fee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feeb7d15-6f7d-4018-978f-43692706fee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b68a1fd-2fb8-455f-98d2-53bb71f92015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b68a1fd-2fb8-455f-98d2-53bb71f92015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6088ed29-70b7-4a34-931e-12d83d1317b7', 'volume_name': 'volume-6088ed29-70b7-4a34-931e-12d83d1317b7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54737312-1602-4407-800e-0e4ef30182bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54737312-1602-4407-800e-0e4ef30182bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abbcaf4-8afc-470c-abb4-fb87f549ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Volume 6088ed29-70b7-4a34-931e-12d83d1317b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6088ed29-70b7-4a34-931e-12d83d1317b7', 'volume_size': 1} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-636065528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6088ed29-70b7-4a34-931e-12d83d1317b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5b05e1153740d6bd9b4007ef00067d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:02Z,use_quota=True,user_id='bc785c405fee49f3ae4459313cf90c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Creating volume 6088ed29-70b7-4a34-931e-12d83d1317b7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:05:02 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6088ed29-70b7-4a34-931e-12d83d1317b7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-678d4452-0326-4b9e-bce8-13493abbbb36" returned: 0 in 0.731s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-678d4452-0326-4b9e-bce8-13493abbbb36 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:02 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6088ed29-70b7-4a34-931e-12d83d1317b7 1073741824 Sep 04 06:05:02 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:02 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-678d4452-0326-4b9e-bce8-13493abbbb36 Sep 04 06:05:02 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:02 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-678d4452-0326-4b9e-bce8-13493abbbb36" returned: 0 in 0.463s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Lock "cinder-quobyte-678d4452-0326-4b9e-bce8-13493abbbb36" released by "delete_volume" :: held 1.253s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Created reservations ['46bc92aa-b726-48cb-864e-4d75a3af727c', '1dea68a2-c26c-4f0d-a9d4-756f01373922', 'a5db1fb0-318e-4532-b8a6-7d96fc9dc0a4', 'e84fe6e2-e78c-432f-8cb1-c7fb05e98946'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:03 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:05:03 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:03 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6088ed29-70b7-4a34-931e-12d83d1317b7 1073741824" returned: 0 in 0.755s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6088ed29-70b7-4a34-931e-12d83d1317b7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:03 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6088ed29-70b7-4a34-931e-12d83d1317b7 Sep 04 06:05:03 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:03 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.372s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:05:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Deleted volume successfully. Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-05a0f054-12b9-4cb1-8e9c-e974960be472 tempest-VolumesTransfersTest-802403753 None] Lock "cinder-678d4452-0326-4b9e-bce8-13493abbbb36-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:03 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6088ed29-70b7-4a34-931e-12d83d1317b7" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abbcaf4-8afc-470c-abb4-fb87f549ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6088ed29-70b7-4a34-931e-12d83d1317b7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ada4e32-e13d-4a7f-b6c8-3c1fa6189f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Volume volume-6088ed29-70b7-4a34-931e-12d83d1317b7 (6088ed29-70b7-4a34-931e-12d83d1317b7): created successfully Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ada4e32-e13d-4a7f-b6c8-3c1fa6189f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Flow 'volume_create_manager' (ea30b307-06b1-42ba-9bad-f26dd6286d2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-936ad4bc-863e-43a6-9295-58eb8fceaf1d tempest-AbsoluteLimitsTests-813502158 None] Created volume successfully. Sep 04 06:05:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Acquiring lock "cinder-6088ed29-70b7-4a34-931e-12d83d1317b7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Lock "cinder-6088ed29-70b7-4a34-931e-12d83d1317b7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Acquiring lock "cinder-quobyte-6088ed29-70b7-4a34-931e-12d83d1317b7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Lock "cinder-quobyte-6088ed29-70b7-4a34-931e-12d83d1317b7" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac08a44-ddf5-4baf-956d-d4b6d660efc1]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6088ed29-70b7-4a34-931e-12d83d1317b7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:05 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6088ed29-70b7-4a34-931e-12d83d1317b7 Sep 04 06:05:05 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:05 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6088ed29-70b7-4a34-931e-12d83d1317b7" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6088ed29-70b7-4a34-931e-12d83d1317b7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:05 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6088ed29-70b7-4a34-931e-12d83d1317b7 Sep 04 06:05:05 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:05 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6088ed29-70b7-4a34-931e-12d83d1317b7" returned: 0 in 0.313s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Lock "cinder-quobyte-6088ed29-70b7-4a34-931e-12d83d1317b7" released by "delete_volume" :: held 0.831s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:05 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Created reservations ['e171c53a-060d-4411-bd04-fed65146cb2d', '64274aad-c6c8-46cc-9785-2cdb4eef5653', 'f03db189-5ace-462a-898a-5395d72a1b93', 'acd0c147-7947-40dc-a12f-ad6c53db994c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:05:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:05 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:05:05 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:06 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:06 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:05:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Deleted volume successfully. Sep 04 06:05:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-26f5a823-8668-4895-8ee3-bcaf072e644e tempest-AbsoluteLimitsTests-813502158 None] Lock "cinder-6088ed29-70b7-4a34-931e-12d83d1317b7-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Flow 'volume_create_manager' (241f39c5-839d-49c5-8fe8-5f055e4c72c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183752e4-27ff-44e8-9dee-5ece4daf29e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183752e4-27ff-44e8-9dee-5ece4daf29e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-881376353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea30c66-3a31-4693-a239-0e8c5cb9127a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='006b8f71dc0b41d598a3c41a1d2f0396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:14Z,use_quota=True,user_id='8d6f325ecbbf4a2e948f8f18af94970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55939de-e614-4644-9dc1-cd96d2ada71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55939de-e614-4644-9dc1-cd96d2ada71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6e21dc-d3cb-4420-9504-973c9a27159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6e21dc-d3cb-4420-9504-973c9a27159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea30c66-3a31-4693-a239-0e8c5cb9127a', 'volume_name': 'volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbc28dc-e711-4a5c-bfb3-b724d1ea2f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbc28dc-e711-4a5c-bfb3-b724d1ea2f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4af8ec-0738-48c6-8c4e-c0fc02295569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Volume 3ea30c66-3a31-4693-a239-0e8c5cb9127a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a', 'volume_size': 1} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-881376353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea30c66-3a31-4693-a239-0e8c5cb9127a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='006b8f71dc0b41d598a3c41a1d2f0396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:14Z,use_quota=True,user_id='8d6f325ecbbf4a2e948f8f18af94970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Creating volume 3ea30c66-3a31-4693-a239-0e8c5cb9127a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:05:13 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:05:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:13 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a 1073741824 Sep 04 06:05:13 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:14 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a 1073741824" returned: 0 in 0.608s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:14 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a Sep 04 06:05:14 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:15 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a" returned: 0 in 0.412s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4af8ec-0738-48c6-8c4e-c0fc02295569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e8991b-89a1-4ce0-bcbe-49212472f976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Volume volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a (3ea30c66-3a31-4693-a239-0e8c5cb9127a): created successfully Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e8991b-89a1-4ce0-bcbe-49212472f976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Flow 'volume_create_manager' (241f39c5-839d-49c5-8fe8-5f055e4c72c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a5c5ee0d-cd94-4e91-8e08-f31e629437d6 tempest-VolumesDeleteCascade-771476221 None] Created volume successfully. Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Flow 'volume_create_manager' (8ad43336-bcb4-4417-b0d6-8988c02ab9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8de4a9-560b-4f5e-b292-13d501993b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8de4a9-560b-4f5e-b292-13d501993b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-343518524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb30eb5-a897-4db8-a722-cde5ba13c718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c07eb606c2a142c0ace5badfa0086d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:15Z,use_quota=True,user_id='2bcbdbc0c5eb4dccb1b2b53e4bc5353b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b7ed98-ae6e-401b-a329-1b883ff86c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b7ed98-ae6e-401b-a329-1b883ff86c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee6e9cb-d9af-406d-9e2d-8b4d45c279d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee6e9cb-d9af-406d-9e2d-8b4d45c279d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb30eb5-a897-4db8-a722-cde5ba13c718', 'volume_name': 'volume-dfb30eb5-a897-4db8-a722-cde5ba13c718', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9149c6be-cdb9-4af5-8bd7-6cdc10c80136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9149c6be-cdb9-4af5-8bd7-6cdc10c80136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffd1277-d6ec-413f-bd82-100d62664f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Volume dfb30eb5-a897-4db8-a722-cde5ba13c718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb30eb5-a897-4db8-a722-cde5ba13c718', 'volume_size': 1} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-343518524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb30eb5-a897-4db8-a722-cde5ba13c718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c07eb606c2a142c0ace5badfa0086d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:15Z,use_quota=True,user_id='2bcbdbc0c5eb4dccb1b2b53e4bc5353b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Creating volume dfb30eb5-a897-4db8-a722-cde5ba13c718 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:05:15 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:05:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dfb30eb5-a897-4db8-a722-cde5ba13c718 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:15 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dfb30eb5-a897-4db8-a722-cde5ba13c718 1073741824 Sep 04 06:05:15 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:16 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dfb30eb5-a897-4db8-a722-cde5ba13c718 1073741824" returned: 0 in 0.822s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dfb30eb5-a897-4db8-a722-cde5ba13c718 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:16 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dfb30eb5-a897-4db8-a722-cde5ba13c718 Sep 04 06:05:16 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:16 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dfb30eb5-a897-4db8-a722-cde5ba13c718" returned: 0 in 0.552s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.147s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffd1277-d6ec-413f-bd82-100d62664f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb30eb5-a897-4db8-a722-cde5ba13c718', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08767b8-d59e-487f-b9a4-eb038b4295ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] Creating offline snapshot 8574a733-add9-4244-a4b1-af26d507c8ad of volume 3ea30c66-3a31-4693-a239-0e8c5cb9127a {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f201ed-1f9c-4bf4-af59-710a90c73ef4]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Volume volume-dfb30eb5-a897-4db8-a722-cde5ba13c718 (dfb30eb5-a897-4db8-a722-cde5ba13c718): created successfully Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08767b8-d59e-487f-b9a4-eb038b4295ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Flow 'volume_create_manager' (8ad43336-bcb4-4417-b0d6-8988c02ab9aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9855e555-da26-4c08-8849-8dac160ce9ae tempest-VolumesTransfersV357Test-511793782 None] Created volume successfully. Sep 04 06:05:17 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a Sep 04 06:05:17 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:17 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a" returned: 0 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:17 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad 1G Sep 04 06:05:17 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:18 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad 1G" returned: 0 in 0.976s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:18 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad Sep 04 06:05:18 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b9e7864a-47b3-4c59-993c-29aa0375b5c4 tempest-VolumesTransfersV357Test-463911207 None] Transfer volume completed successfully. Sep 04 06:05:18 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad" returned: 0 in 0.546s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:18 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad is being set with open permissions: ugo+rw Sep 04 06:05:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:18 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad Sep 04 06:05:18 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:19 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad" returned: 0 in 0.523s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:19 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.info Sep 04 06:05:19 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Acquiring lock "cinder-dfb30eb5-a897-4db8-a722-cde5ba13c718-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Lock "cinder-dfb30eb5-a897-4db8-a722-cde5ba13c718-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:19 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Acquiring lock "cinder-quobyte-dfb30eb5-a897-4db8-a722-cde5ba13c718" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.info" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:19 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.info is being set with open permissions: ugo+rw Sep 04 06:05:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Lock "cinder-quobyte-dfb30eb5-a897-4db8-a722-cde5ba13c718" acquired by "delete_volume" :: waited 0.069s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:20 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.info Sep 04 06:05:20 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c1e1c6-e46e-43ae-8e9f-142666d62e61]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dfb30eb5-a897-4db8-a722-cde5ba13c718 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:20 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dfb30eb5-a897-4db8-a722-cde5ba13c718 Sep 04 06:05:20 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:20 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.info" returned: 0 in 0.586s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.786s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0143c9e6-f4cb-40bf-a08c-8d4cb1c6651a tempest-VolumesDeleteCascade-771476221 None] Create snapshot completed successfully Sep 04 06:05:21 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dfb30eb5-a897-4db8-a722-cde5ba13c718" returned: 0 in 0.964s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dfb30eb5-a897-4db8-a722-cde5ba13c718 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:21 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dfb30eb5-a897-4db8-a722-cde5ba13c718 Sep 04 06:05:21 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] Creating offline snapshot 7d3690b1-ad84-4548-9c51-948263eeb1e0 of volume 3ea30c66-3a31-4693-a239-0e8c5cb9127a {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:05:21 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-dfb30eb5-a897-4db8-a722-cde5ba13c718" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aa8190-13ac-47d4-b746-512babc9b5db]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Lock "cinder-quobyte-dfb30eb5-a897-4db8-a722-cde5ba13c718" released by "delete_volume" :: held 1.479s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Created reservations ['8a52e312-bef3-4494-9b93-a235a5d1732d', '0a4504eb-c38c-45ec-aad5-349b4997fede', '67d09886-73ea-43dd-8ec9-0cefc4cec754', '03c690f4-6bc2-4b5f-9b7b-f46f659eb0ba'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:05:21 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad Sep 04 06:05:21 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:21 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:05:21 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:22 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad" returned: 0 in 0.684s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:05:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:22 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 1G Sep 04 06:05:22 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:22 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.687s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:22 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:05:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Deleted volume successfully. Sep 04 06:05:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b987cf24-4b0d-4545-8003-d0ca469112a7 tempest-VolumesTransfersV357Test-1295012929 None] Lock "cinder-dfb30eb5-a897-4db8-a722-cde5ba13c718-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:23 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 1G" returned: 0 in 1.034s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:23 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 Sep 04 06:05:23 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Flow 'volume_create_manager' (10650a3a-e6dd-47ec-b6e6-729278cdf8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2913747-931f-426a-a7ba-90a2a4c040d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2913747-931f-426a-a7ba-90a2a4c040d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-595641027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c83b33-7967-457b-b170-5730af77d310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c07eb606c2a142c0ace5badfa0086d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:23Z,use_quota=True,user_id='2bcbdbc0c5eb4dccb1b2b53e4bc5353b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2f8170-b3b2-477c-b296-09623413bb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2f8170-b3b2-477c-b296-09623413bb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5835cb36-a83c-416f-a8a7-d5c6f553fd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5835cb36-a83c-416f-a8a7-d5c6f553fd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c83b33-7967-457b-b170-5730af77d310', 'volume_name': 'volume-44c83b33-7967-457b-b170-5730af77d310', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c59d79f-4603-4d2f-842b-fff44faaae66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c59d79f-4603-4d2f-842b-fff44faaae66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0c2b98-0bdc-42d5-a411-7e35e15068fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Volume 44c83b33-7967-457b-b170-5730af77d310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c83b33-7967-457b-b170-5730af77d310', 'volume_size': 1} Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:23 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0" returned: 0 in 0.757s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:23 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 is being set with open permissions: ugo+rw Sep 04 06:05:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:24 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 Sep 04 06:05:24 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:24 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0" returned: 0 in 0.337s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.047s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-595641027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c83b33-7967-457b-b170-5730af77d310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c07eb606c2a142c0ace5badfa0086d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:23Z,use_quota=True,user_id='2bcbdbc0c5eb4dccb1b2b53e4bc5353b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Creating volume 44c83b33-7967-457b-b170-5730af77d310 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:05:24 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-44c83b33-7967-457b-b170-5730af77d310 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:24 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-44c83b33-7967-457b-b170-5730af77d310 1073741824 Sep 04 06:05:24 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-efa7d19b-0d61-49c0-a0ec-5cdb6194503a tempest-VolumesDeleteCascade-771476221 None] Create snapshot completed successfully Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Flow 'volume_create_manager' (adc7723b-0282-49fc-b9d6-b3b86053a9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd4bc79-b653-4107-8ecf-508d43962016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd4bc79-b653-4107-8ecf-508d43962016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-416354495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62cd6c2-72ef-4201-92b7-2199e39ba317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f200fb93384e0e93c5b6d905181c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:25Z,use_quota=True,user_id='f030e6f1aed941fe8decaeb94e61b88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8e99dc-87ee-4e33-aa62-e39483028b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8e99dc-87ee-4e33-aa62-e39483028b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fef8986-54bb-4225-9e4e-05e304891311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fef8986-54bb-4225-9e4e-05e304891311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62cd6c2-72ef-4201-92b7-2199e39ba317', 'volume_name': 'volume-d62cd6c2-72ef-4201-92b7-2199e39ba317', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c74ed34-acaa-483f-a26f-99d60c06d508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c74ed34-acaa-483f-a26f-99d60c06d508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be54ec1-b669-4323-aa62-ed91c4b1be5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Volume d62cd6c2-72ef-4201-92b7-2199e39ba317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62cd6c2-72ef-4201-92b7-2199e39ba317', 'volume_size': 1} Sep 04 06:05:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:25 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-44c83b33-7967-457b-b170-5730af77d310 1073741824" returned: 0 in 0.819s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-44c83b33-7967-457b-b170-5730af77d310 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:25 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:05:25 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:25 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-44c83b33-7967-457b-b170-5730af77d310 Sep 04 06:05:25 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-3ea30c66-3a31-4693-a239-0e8c5cb9127a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-3ea30c66-3a31-4693-a239-0e8c5cb9127a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:25 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.702s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:05:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:05:26 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Performing cascade delete. {{(pid=87132) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-44c83b33-7967-457b-b170-5730af77d310" returned: 0 in 0.765s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.289s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-416354495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62cd6c2-72ef-4201-92b7-2199e39ba317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f200fb93384e0e93c5b6d905181c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:25Z,use_quota=True,user_id='f030e6f1aed941fe8decaeb94e61b88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Creating volume d62cd6c2-72ef-4201-92b7-2199e39ba317 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:05:26 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d62cd6c2-72ef-4201-92b7-2199e39ba317 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-7d3690b1-ad84-4548-9c51-948263eeb1e0-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0c2b98-0bdc-42d5-a411-7e35e15068fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c83b33-7967-457b-b170-5730af77d310', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:26 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d62cd6c2-72ef-4201-92b7-2199e39ba317 1073741824 Sep 04 06:05:26 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5451d6b5-709a-4b11-9485-caa5b761ee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Volume volume-44c83b33-7967-457b-b170-5730af77d310 (44c83b33-7967-457b-b170-5730af77d310): created successfully Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5451d6b5-709a-4b11-9485-caa5b761ee8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Flow 'volume_create_manager' (10650a3a-e6dd-47ec-b6e6-729278cdf8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-7d3690b1-ad84-4548-9c51-948263eeb1e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fc05f50b-dcdd-4d6e-abb7-6166820f74c1 tempest-VolumesTransfersV357Test-511793782 None] Created volume successfully. Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-quobyte-3ea30c66-3a31-4693-a239-0e8c5cb9127a" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-3ea30c66-3a31-4693-a239-0e8c5cb9127a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-quobyte-7d3690b1-ad84-4548-9c51-948263eeb1e0" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-7d3690b1-ad84-4548-9c51-948263eeb1e0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Deleting offline snapshot 7d3690b1-ad84-4548-9c51-948263eeb1e0 of volume 3ea30c66-3a31-4693-a239-0e8c5cb9127a {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] snapshot_file for this snap is: volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c627843-4aa5-4545-b475-644257e5aaa8]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:26 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 Sep 04 06:05:26 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:26 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d62cd6c2-72ef-4201-92b7-2199e39ba317 1073741824" returned: 0 in 0.601s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d62cd6c2-72ef-4201-92b7-2199e39ba317 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:26 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d62cd6c2-72ef-4201-92b7-2199e39ba317 Sep 04 06:05:26 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:26 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0" returned: 0 in 0.593s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b73a19-00aa-41db-a51a-1ed873818d25]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:27 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad Sep 04 06:05:27 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Acquiring lock "cinder-44c83b33-7967-457b-b170-5730af77d310-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:27 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Lock "cinder-44c83b33-7967-457b-b170-5730af77d310-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d62cd6c2-72ef-4201-92b7-2199e39ba317" returned: 0 in 0.635s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be54ec1-b669-4323-aa62-ed91c4b1be5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62cd6c2-72ef-4201-92b7-2199e39ba317', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c34dd5a-1bae-4638-b402-cbbb3478f970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:27 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Volume volume-d62cd6c2-72ef-4201-92b7-2199e39ba317 (d62cd6c2-72ef-4201-92b7-2199e39ba317): created successfully Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c34dd5a-1bae-4638-b402-cbbb3478f970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Flow 'volume_create_manager' (adc7723b-0282-49fc-b9d6-b3b86053a9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Acquiring lock "cinder-quobyte-44c83b33-7967-457b-b170-5730af77d310" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d6fb28f0-1681-4e95-8f08-a6d4c5c6ad5c tempest-TestMinimumBasicScenario-1721251367 None] Created volume successfully. Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Lock "cinder-quobyte-44c83b33-7967-457b-b170-5730af77d310" acquired by "delete_volume" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b633c204-5858-486b-83f5-a623532bf6e6]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-44c83b33-7967-457b-b170-5730af77d310 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:27 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad" returned: 0 in 0.644s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:05:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:27 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 Sep 04 06:05:27 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:27 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-44c83b33-7967-457b-b170-5730af77d310 Sep 04 06:05:27 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:28 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-44c83b33-7967-457b-b170-5730af77d310" returned: 0 in 0.802s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-44c83b33-7967-457b-b170-5730af77d310 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:28 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-44c83b33-7967-457b-b170-5730af77d310 Sep 04 06:05:28 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:28 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0" returned: 0 in 0.901s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:28 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0 Sep 04 06:05:28 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:28 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-44c83b33-7967-457b-b170-5730af77d310" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Lock "cinder-quobyte-44c83b33-7967-457b-b170-5730af77d310" released by "delete_volume" :: held 1.292s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Created reservations ['e572568d-7475-4762-908b-4c838aad27cd', '68d17404-f6e9-4c7b-8a16-b8c719fd2aaf', '46145ece-cdfa-4a4f-a184-ab468b4e7a9c', '50494fa3-31ac-465f-984b-a9d78bfac6ec'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:05:29 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.7d3690b1-ad84-4548-9c51-948263eeb1e0" returned: 0 in 0.524s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-7d3690b1-ad84-4548-9c51-948263eeb1e0" released by "_delete_snapshot" :: held 2.868s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-3ea30c66-3a31-4693-a239-0e8c5cb9127a" released by "delete_snapshot" :: held 2.930s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:29 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:05:29 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-d0711603-da1e-4cc0-9adc-b5adcce4f92b req-1910b613-2cc0-492d-8bf4-445b60b5eaf8 tempest-TestMinimumBasicScenario-1721251367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-d0711603-da1e-4cc0-9adc-b5adcce4f92b req-1910b613-2cc0-492d-8bf4-445b60b5eaf8 tempest-TestMinimumBasicScenario-1721251367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-d0711603-da1e-4cc0-9adc-b5adcce4f92b req-1910b613-2cc0-492d-8bf4-445b60b5eaf8 tempest-TestMinimumBasicScenario-1721251367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-d0711603-da1e-4cc0-9adc-b5adcce4f92b req-1910b613-2cc0-492d-8bf4-445b60b5eaf8 tempest-TestMinimumBasicScenario-1721251367 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-d62cd6c2-72ef-4201-92b7-2199e39ba317', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5013f82-be67-4ba6-be0f-80770c3b8e46', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Created reservations ['2338daa2-1e0c-40b8-9bf3-f480b14bcbe7', 'fbdbeab3-d7ca-4637-8c9a-ae29756fcd38', '5c98926b-84de-4983-898d-0f73793a469a', '66f985ea-c4a3-4592-b47f-74ea7c01bce9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:05:29 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.435s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:05:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-d0711603-da1e-4cc0-9adc-b5adcce4f92b req-1910b613-2cc0-492d-8bf4-445b60b5eaf8 tempest-TestMinimumBasicScenario-1721251367 None] attachment_update completed successfully. Sep 04 06:05:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Deleted volume successfully. Sep 04 06:05:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Delete snapshot completed successfully. Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-7d3690b1-ad84-4548-9c51-948263eeb1e0-delete_snapshot" released by "delete_snapshot" :: held 3.462s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-8574a733-add9-4244-a4b1-af26d507c8ad-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f4a6edf-54cd-422b-b314-3b6d13815364 tempest-VolumesTransfersV357Test-1295012929 None] Lock "cinder-44c83b33-7967-457b-b170-5730af77d310-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-8574a733-add9-4244-a4b1-af26d507c8ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-quobyte-3ea30c66-3a31-4693-a239-0e8c5cb9127a" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-3ea30c66-3a31-4693-a239-0e8c5cb9127a" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-quobyte-8574a733-add9-4244-a4b1-af26d507c8ad" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-8574a733-add9-4244-a4b1-af26d507c8ad" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Deleting offline snapshot 8574a733-add9-4244-a4b1-af26d507c8ad of volume 3ea30c66-3a31-4693-a239-0e8c5cb9127a {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] snapshot_file for this snap is: volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bdb7ff-f5c2-4298-96a2-79a79b803d93]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:30 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad Sep 04 06:05:30 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:30 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad" returned: 0 in 0.670s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:05:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e5a2e2-cb68-4524-b2e6-667655a84471]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:30 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a Sep 04 06:05:30 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:31 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a" returned: 0 in 0.617s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:31 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad Sep 04 06:05:31 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:31 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad" returned: 0 in 0.456s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:31 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad Sep 04 06:05:31 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:32 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a.8574a733-add9-4244-a4b1-af26d507c8ad" returned: 0 in 0.289s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-8574a733-add9-4244-a4b1-af26d507c8ad" released by "_delete_snapshot" :: held 2.241s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-3ea30c66-3a31-4693-a239-0e8c5cb9127a" released by "delete_snapshot" :: held 2.289s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Created reservations ['37529398-b3b8-4246-8ce9-411669bb242f', 'e1763c24-36a3-4551-8152-08495af05c2e', '663fb48b-30aa-4079-a833-2622ee2881d2', '533d482e-b136-4e3e-a71d-64a942aaa03a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:05:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Delete snapshot completed successfully. Sep 04 06:05:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-8574a733-add9-4244-a4b1-af26d507c8ad-delete_snapshot" released by "delete_snapshot" :: held 2.530s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Snapshots deleted, issuing volume delete {{(pid=87132) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 04 06:05:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-quobyte-3ea30c66-3a31-4693-a239-0e8c5cb9127a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-3ea30c66-3a31-4693-a239-0e8c5cb9127a" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e79f33-038a-413d-b33d-08fd81c6fabd]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:32 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a Sep 04 06:05:32 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:32 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a" returned: 0 in 0.483s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:32 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a Sep 04 06:05:32 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:33 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ea30c66-3a31-4693-a239-0e8c5cb9127a" returned: 0 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-3ea30c66-3a31-4693-a239-0e8c5cb9127a" released by "delete_volume" :: held 0.932s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:33 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Created reservations ['e969a710-d3b6-4218-8649-9a2e2b88b0f7', '84bae6c2-1dfc-43e4-b4eb-74974940ee4f', 'ccb8c9f9-b137-4e9c-8c3a-c7dc0ad00b24', '4d7bff0a-24ba-4480-bec6-cf8a17970e61'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:05:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:33 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:05:33 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:33 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.301s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:33 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:05:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Deleted volume successfully. Sep 04 06:05:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc9bae54-8501-40f3-90e8-812b4926602b tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-3ea30c66-3a31-4693-a239-0e8c5cb9127a-delete_volume" released by "delete_volume" :: held 7.719s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Flow 'volume_create_manager' (b25feb4f-f09a-4bef-9878-7c1de04e86fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfddac2-b17f-4b14-84a2-8d27b7eb4434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfddac2-b17f-4b14-84a2-8d27b7eb4434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-425809153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='006b8f71dc0b41d598a3c41a1d2f0396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:35Z,use_quota=True,user_id='8d6f325ecbbf4a2e948f8f18af94970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ecae4e-20df-408a-bc5a-e67abefb29fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ecae4e-20df-408a-bc5a-e67abefb29fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea5a0d0-a6d9-413f-a139-cd996305c9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea5a0d0-a6d9-413f-a139-cd996305c9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15b6bb2-5d61-4aaa-a8a7-9fbbb0696077', 'volume_name': 'volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a42abf-5391-47e1-93cd-2cd863ae9224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a42abf-5391-47e1-93cd-2cd863ae9224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192c162e-40f6-4443-bf7d-360288a63ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Volume d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077', 'volume_size': 1} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-425809153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='006b8f71dc0b41d598a3c41a1d2f0396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:35Z,use_quota=True,user_id='8d6f325ecbbf4a2e948f8f18af94970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Creating volume d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:05:34 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:05:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:35 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 1073741824 Sep 04 06:05:35 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:35 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 1073741824" returned: 0 in 0.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:35 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 Sep 04 06:05:35 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:35 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:05:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192c162e-40f6-4443-bf7d-360288a63ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791b5c1a-80ef-4229-8268-99fd9b73578a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Volume volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 (d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077): created successfully Sep 04 06:05:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791b5c1a-80ef-4229-8268-99fd9b73578a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Flow 'volume_create_manager' (b25feb4f-f09a-4bef-9878-7c1de04e86fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-056cc06f-a634-4531-947b-06688889d120 tempest-VolumesDeleteCascade-771476221 None] Created volume successfully. Sep 04 06:05:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] Creating offline snapshot d74ab382-5c51-45a8-a406-e0c330f5b487 of volume d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:05:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcf5981-00d6-4577-9e67-095a877692a2]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:37 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 Sep 04 06:05:37 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:37 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077" returned: 0 in 0.563s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:37 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 1G Sep 04 06:05:37 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:38 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 1G" returned: 0 in 0.687s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:38 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 Sep 04 06:05:38 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:38 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:38 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 is being set with open permissions: ugo+rw Sep 04 06:05:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:38 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 Sep 04 06:05:38 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:39 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:39 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.info Sep 04 06:05:39 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:39 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.info" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:39 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.info is being set with open permissions: ugo+rw Sep 04 06:05:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:39 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.info Sep 04 06:05:39 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:40 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.info" returned: 0 in 0.376s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.788s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-79948ad0-3603-4601-8f08-c37da62c19f2 tempest-VolumesDeleteCascade-771476221 None] Create snapshot completed successfully Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Flow 'volume_create_manager' (76efdf4a-bca4-4567-9acd-732655c1a9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2965851f-f402-49bc-b768-fcb7f5e12b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=100,cinder:INSERT=32,cinder:UPDATE=130,cinder:DELETE=10 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2965851f-f402-49bc-b768-fcb7f5e12b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-483679527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35653468-f099-4cdb-a040-26b185abc060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='006b8f71dc0b41d598a3c41a1d2f0396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d74ab382-5c51-45a8-a406-e0c330f5b487,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:41Z,use_quota=True,user_id='8d6f325ecbbf4a2e948f8f18af94970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b79b37-195d-4d80-905c-cee7361edf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b79b37-195d-4d80-905c-cee7361edf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467dcd37-1f0e-497b-8e59-b2e473d2e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467dcd37-1f0e-497b-8e59-b2e473d2e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35653468-f099-4cdb-a040-26b185abc060', 'volume_name': 'volume-35653468-f099-4cdb-a040-26b185abc060', 'volume_size': 1, 'snapshot_id': 'd74ab382-5c51-45a8-a406-e0c330f5b487'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4dd9880-6c89-4fb2-ac9d-00a762a1f59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4dd9880-6c89-4fb2-ac9d-00a762a1f59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c019342-2f4d-47b4-b347-12a0f1532f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Volume 35653468-f099-4cdb-a040-26b185abc060: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35653468-f099-4cdb-a040-26b185abc060', 'volume_size': 1, 'snapshot_id': 'd74ab382-5c51-45a8-a406-e0c330f5b487'} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=112,cinder:SELECT=97,cinder:INSERT=27,cinder:DELETE=11 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-quobyte-d74ab382-5c51-45a8-a406-e0c330f5b487-35653468-f099-4cdb-a040-26b185abc060" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-d74ab382-5c51-45a8-a406-e0c330f5b487-35653468-f099-4cdb-a040-26b185abc060" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Creating volume 35653468-f099-4cdb-a040-26b185abc060 from snapshot d74ab382-5c51-45a8-a406-e0c330f5b487 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-quobyte-35653468-f099-4cdb-a040-26b185abc060" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-35653468-f099-4cdb-a040-26b185abc060" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] snapshot: d74ab382-5c51-45a8-a406-e0c330f5b487, volume: 35653468-f099-4cdb-a040-26b185abc060, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a53ddab-0db4-460d-9aa0-9d3cb04b2925]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:41 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 Sep 04 06:05:41 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:41 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487" returned: 0 in 0.505s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d938f422-04f1-43f2-b897-dffd4e884c4d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:42 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 Sep 04 06:05:42 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:42 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077" returned: 0 in 0.501s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] will copy from snapshot at /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 06:05:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 06:05:42 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Path /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 06:05:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:42 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060 Sep 04 06:05:42 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:05:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Flow 'volume_create_manager' (802136ea-f11b-4021-886e-14ee2d96b31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf88256-1fc9-4455-aab0-19698dc59420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf88256-1fc9-4455-aab0-19698dc59420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-534229156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc5cdad-d45c-421d-a538-13da0813d3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85854d6f5f0419d84383d3e654dfc99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:43Z,use_quota=True,user_id='acad79e1fcc8476dbfb277dee3b5cc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30bea46-dd20-4ba7-a99e-4061be002258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30bea46-dd20-4ba7-a99e-4061be002258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a959da-39f5-4b47-be3a-c38b06df5e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a959da-39f5-4b47-be3a-c38b06df5e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc5cdad-d45c-421d-a538-13da0813d3d7', 'volume_name': 'volume-8dc5cdad-d45c-421d-a538-13da0813d3d7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7b46bd-c894-49f4-9502-62952b71ad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7b46bd-c894-49f4-9502-62952b71ad8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd106c0-ff9c-43cd-9a53-0c50d06ca2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Volume 8dc5cdad-d45c-421d-a538-13da0813d3d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc5cdad-d45c-421d-a538-13da0813d3d7', 'volume_size': 1} Sep 04 06:05:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:48 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060" returned: 0 in 6.015s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:05:48 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Converted 1024.00 MB image at 170.23 MB/s Sep 04 06:05:48 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060 is being set with open permissions: ugo+rw Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:48 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060 Sep 04 06:05:48 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:48 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060" returned: 0 in 0.317s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-35653468-f099-4cdb-a040-26b185abc060" released by "_copy_volume_from_snapshot" :: held 7.458s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-d74ab382-5c51-45a8-a406-e0c330f5b487-35653468-f099-4cdb-a040-26b185abc060" released by "_create_volume_from_snapshot" :: held 7.552s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.574s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.768s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-534229156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc5cdad-d45c-421d-a538-13da0813d3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85854d6f5f0419d84383d3e654dfc99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:43Z,use_quota=True,user_id='acad79e1fcc8476dbfb277dee3b5cc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Creating volume 8dc5cdad-d45c-421d-a538-13da0813d3d7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:05:48 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:48 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 1073741824 Sep 04 06:05:48 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c019342-2f4d-47b4-b347-12a0f1532f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35653468-f099-4cdb-a040-26b185abc060', 'volume_size': 1, 'snapshot_id': 'd74ab382-5c51-45a8-a406-e0c330f5b487'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f905bd6-bb92-4de4-b079-236644365313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:49 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Volume volume-35653468-f099-4cdb-a040-26b185abc060 (35653468-f099-4cdb-a040-26b185abc060): created successfully Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f905bd6-bb92-4de4-b079-236644365313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Flow 'volume_create_manager' (76efdf4a-bca4-4567-9acd-732655c1a9d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c26e6c06-7ba0-46ac-add9-61d92c585ff7 tempest-VolumesDeleteCascade-771476221 None] Created volume successfully. Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Performing cascade delete. {{(pid=87132) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-d74ab382-5c51-45a8-a406-e0c330f5b487-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-d74ab382-5c51-45a8-a406-e0c330f5b487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-quobyte-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-quobyte-d74ab382-5c51-45a8-a406-e0c330f5b487" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:49 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 1073741824" returned: 0 in 0.710s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-d74ab382-5c51-45a8-a406-e0c330f5b487" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Deleting offline snapshot d74ab382-5c51-45a8-a406-e0c330f5b487 of volume d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] snapshot_file for this snap is: volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7489d094-09c5-463f-b789-1ddfb9956256]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:49 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 Sep 04 06:05:49 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:50 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 Sep 04 06:05:50 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:50 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7" returned: 0 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd106c0-ff9c-43cd-9a53-0c50d06ca2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc5cdad-d45c-421d-a538-13da0813d3d7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ca7ff9-792a-4a5f-986b-77378f0372cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:50 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Volume volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 (8dc5cdad-d45c-421d-a538-13da0813d3d7): created successfully Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ca7ff9-792a-4a5f-986b-77378f0372cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Flow 'volume_create_manager' (802136ea-f11b-4021-886e-14ee2d96b31c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7542a23b-463b-4701-a72a-a35049db004d tempest-SnapshotDependencyTests-1433277344 None] Created volume successfully. Sep 04 06:05:50 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487" returned: 0 in 0.580s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f2682f-1d67-48df-9f89-92b940cc3198]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:50 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 Sep 04 06:05:50 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:50 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077" returned: 0 in 0.607s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:51 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 Sep 04 06:05:51 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:51 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487" returned: 0 in 0.445s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:51 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487 Sep 04 06:05:51 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] Creating offline snapshot da89769d-c26d-43c3-9246-0e060ecf5a87 of volume 8dc5cdad-d45c-421d-a538-13da0813d3d7 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:05:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c325ec-df01-42a7-8560-cc4cb380f772]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:51 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077.d74ab382-5c51-45a8-a406-e0c330f5b487" returned: 0 in 0.380s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-d74ab382-5c51-45a8-a406-e0c330f5b487" released by "_delete_snapshot" :: held 2.194s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:51 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 Sep 04 06:05:51 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077" released by "delete_snapshot" :: held 2.268s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:51 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Created reservations ['c972bc90-2010-4081-898b-5fdcbc6e625c', 'f7f35da7-e1c5-4bb5-9de6-0e6cbeb5ccba', '18c8316a-5fb9-4397-b830-5f9d8ed2606e', '9283eb0d-608c-4710-921e-c52804825123'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:05:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Delete snapshot completed successfully. Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-d74ab382-5c51-45a8-a406-e0c330f5b487-delete_snapshot" released by "delete_snapshot" :: held 2.473s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Snapshots deleted, issuing volume delete {{(pid=87132) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-quobyte-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d092c059-6a4b-489a-81e9-ea150253f287]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:52 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7" returned: 0 in 0.533s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:52 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 1G Sep 04 06:05:52 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:52 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 Sep 04 06:05:52 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:52 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:52 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077 Sep 04 06:05:52 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:52 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 1G" returned: 0 in 0.602s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:52 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 Sep 04 06:05:52 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:52 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077" released by "delete_volume" :: held 0.832s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Created reservations ['e4ab6c6a-6aff-46ed-b7f0-a83ca60db577', '5fb253a3-01e5-40d1-ae4d-6b10aaaa64f7', 'a29be546-2b65-4479-bdef-9de8f7bcd682', 'cef4d833-5581-4951-9200-748c0812ab9c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:53 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:05:53 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:53 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87" returned: 0 in 0.434s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:53 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 is being set with open permissions: ugo+rw Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:53 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 Sep 04 06:05:53 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:53 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:05:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Deleted volume successfully. Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b442f412-1e22-48c5-b450-649123da46ce tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-d15b6bb2-5d61-4aaa-a8a7-9fbbb0696077-delete_volume" released by "delete_volume" :: held 4.038s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:53 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87" returned: 0 in 0.418s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:53 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.info Sep 04 06:05:53 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:54 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.info" returned: 0 in 0.329s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:54 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.info is being set with open permissions: ugo+rw Sep 04 06:05:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:54 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.info Sep 04 06:05:54 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-35653468-f099-4cdb-a040-26b185abc060-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-35653468-f099-4cdb-a040-26b185abc060-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "cinder-quobyte-35653468-f099-4cdb-a040-26b185abc060" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-35653468-f099-4cdb-a040-26b185abc060" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7201c9a6-07de-459d-ad90-f7ff02a1f8d2]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:54 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.info" returned: 0 in 0.294s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:54 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060 Sep 04 06:05:54 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8a7acf73-8a32-4364-a06e-00408b66e528 tempest-SnapshotDependencyTests-1433277344 None] Create snapshot completed successfully Sep 04 06:05:54 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060" returned: 0 in 0.468s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:54 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060 Sep 04 06:05:54 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:55 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-35653468-f099-4cdb-a040-26b185abc060" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-quobyte-35653468-f099-4cdb-a040-26b185abc060" released by "delete_volume" :: held 0.798s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Created reservations ['54a753a0-349c-427c-a2ba-7932645cb1bf', 'f371e508-064a-4094-9bb7-eda18b4519bf', '2b7fff4d-7876-47c0-aa2d-dadb65f56f18', 'b583ebbb-e9c5-4a79-ba66-8c8c122b4fce'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:55 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:05:55 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:55 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:05:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Deleted volume successfully. Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-19c8d7ff-bb20-474f-bd29-0395ae5d4725 tempest-VolumesDeleteCascade-771476221 None] Lock "cinder-35653468-f099-4cdb-a040-26b185abc060-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Flow 'volume_create_manager' (853eed84-14be-4dc0-8a77-1bce1e0ba9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2846b56c-f4c5-4382-92e9-327bbdeb348c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2846b56c-f4c5-4382-92e9-327bbdeb348c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29de27fd-7f80-49c5-a4f3-44c4671a7483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85854d6f5f0419d84383d3e654dfc99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da89769d-c26d-43c3-9246-0e060ecf5a87,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:56Z,use_quota=True,user_id='acad79e1fcc8476dbfb277dee3b5cc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195077a0-0e95-4d4b-adc5-9846d53baf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195077a0-0e95-4d4b-adc5-9846d53baf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72d69ec-4c10-4c7a-8fb9-6ac1b6a5ba6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72d69ec-4c10-4c7a-8fb9-6ac1b6a5ba6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '29de27fd-7f80-49c5-a4f3-44c4671a7483', 'volume_name': 'volume-29de27fd-7f80-49c5-a4f3-44c4671a7483', 'volume_size': 1, 'snapshot_id': 'da89769d-c26d-43c3-9246-0e060ecf5a87'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a44d15-f8f2-40f6-9e81-24e54e382d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a44d15-f8f2-40f6-9e81-24e54e382d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ca5d40-23f0-47aa-b8d2-a42ae2fcda1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Volume 29de27fd-7f80-49c5-a4f3-44c4671a7483: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-29de27fd-7f80-49c5-a4f3-44c4671a7483', 'volume_size': 1, 'snapshot_id': 'da89769d-c26d-43c3-9246-0e060ecf5a87'} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "cinder-quobyte-da89769d-c26d-43c3-9246-0e060ecf5a87-29de27fd-7f80-49c5-a4f3-44c4671a7483" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-quobyte-da89769d-c26d-43c3-9246-0e060ecf5a87-29de27fd-7f80-49c5-a4f3-44c4671a7483" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Creating volume 29de27fd-7f80-49c5-a4f3-44c4671a7483 from snapshot da89769d-c26d-43c3-9246-0e060ecf5a87 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:05:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "cinder-quobyte-29de27fd-7f80-49c5-a4f3-44c4671a7483" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-quobyte-29de27fd-7f80-49c5-a4f3-44c4671a7483" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] snapshot: da89769d-c26d-43c3-9246-0e060ecf5a87, volume: 29de27fd-7f80-49c5-a4f3-44c4671a7483, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a5d5c5-ee16-4573-8cf1-20ccf43d0d93]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:56 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 Sep 04 06:05:56 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:56 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Flow 'volume_create_manager' (25c8e9c7-2534-478f-b2a1-eb660864c6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a14f14-af1f-4de2-8207-89e6b47ed6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dc5cdad-d45c-421d-a538-13da0813d3d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a14f14-af1f-4de2-8207-89e6b47ed6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2076638335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7094adc7-8b7e-4cf0-8a70-e023d2cd12d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eaa0606a32e4240b04febe33cb19d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:56Z,use_quota=True,user_id='9477a57494e5400e94756bf7a660fafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8f7433-0ec7-4868-b329-f9ebef71d797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8f7433-0ec7-4868-b329-f9ebef71d797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32c0ffb-d4b5-4d6a-95e6-9643328677de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32c0ffb-d4b5-4d6a-95e6-9643328677de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7094adc7-8b7e-4cf0-8a70-e023d2cd12d3', 'volume_name': 'volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3310f2b3-61c8-4654-a30f-9e9138d0b9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3310f2b3-61c8-4654-a30f-9e9138d0b9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d4045c-1f49-4f96-bd3b-9eef463e0b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:05:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Volume 7094adc7-8b7e-4cf0-8a70-e023d2cd12d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3', 'volume_size': 1} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c153f24-3285-4c26-98db-9d0be445d3bf]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:05:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:56 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 Sep 04 06:05:56 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:05:57 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 04 06:05:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7" returned: 0 in 0.407s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:05:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] will copy from snapshot at /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 06:05:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 06:05:57 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Path /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 06:05:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:05:57 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483 Sep 04 06:05:57 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:01 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:06:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Flow 'volume_create_manager' (1da822a5-08d0-4e00-a4d4-42044d2044f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:06:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520302ce-ec22-4610-a0c5-6f9c775b3bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520302ce-ec22-4610-a0c5-6f9c775b3bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-107659521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13a89e5-0e89-4358-9c22-611ce5286c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddadca4e07e4dbc9de2c987c97bec00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:02Z,use_quota=True,user_id='eaca925a52414a0ea7f14a520691cf97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30ec996-5960-45c9-989c-95b044e765f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30ec996-5960-45c9-989c-95b044e765f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ad52bc-b496-405f-bc41-32723ca46a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ad52bc-b496-405f-bc41-32723ca46a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b13a89e5-0e89-4358-9c22-611ce5286c6c', 'volume_name': 'volume-b13a89e5-0e89-4358-9c22-611ce5286c6c', 'volume_size': 2}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ac6a09-85bc-459a-9ba7-bcc584828b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ac6a09-85bc-459a-9ba7-bcc584828b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8e973c-1a16-46b9-897d-3883629c9855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Volume b13a89e5-0e89-4358-9c22-611ce5286c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b13a89e5-0e89-4358-9c22-611ce5286c6c', 'volume_size': 2} Sep 04 06:06:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:03 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483" returned: 0 in 6.157s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:06:03 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Converted 1024.00 MB image at 166.30 MB/s Sep 04 06:06:03 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483 is being set with open permissions: ugo+rw Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:03 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483 Sep 04 06:06:03 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:03 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483" returned: 0 in 0.237s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-quobyte-29de27fd-7f80-49c5-a4f3-44c4671a7483" released by "_copy_volume_from_snapshot" :: held 7.455s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-quobyte-da89769d-c26d-43c3-9246-0e060ecf5a87-29de27fd-7f80-49c5-a4f3-44c4671a7483" released by "_create_volume_from_snapshot" :: held 7.543s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.571s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.875s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2076638335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7094adc7-8b7e-4cf0-8a70-e023d2cd12d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eaa0606a32e4240b04febe33cb19d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:56Z,use_quota=True,user_id='9477a57494e5400e94756bf7a660fafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Creating volume 7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:06:03 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:03 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 1073741824 Sep 04 06:06:03 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ca5d40-23f0-47aa-b8d2-a42ae2fcda1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29de27fd-7f80-49c5-a4f3-44c4671a7483', 'volume_size': 1, 'snapshot_id': 'da89769d-c26d-43c3-9246-0e060ecf5a87'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4d3354-039b-488a-a55b-678052c8aaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Volume volume-29de27fd-7f80-49c5-a4f3-44c4671a7483 (29de27fd-7f80-49c5-a4f3-44c4671a7483): created successfully Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4d3354-039b-488a-a55b-678052c8aaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Flow 'volume_create_manager' (853eed84-14be-4dc0-8a77-1bce1e0ba9f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:06:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-941fd253-a715-4222-8289-8a6608fa3871 tempest-SnapshotDependencyTests-1433277344 None] Created volume successfully. Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "cinder-da89769d-c26d-43c3-9246-0e060ecf5a87-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-da89769d-c26d-43c3-9246-0e060ecf5a87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "cinder-quobyte-8dc5cdad-d45c-421d-a538-13da0813d3d7" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-quobyte-8dc5cdad-d45c-421d-a538-13da0813d3d7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "cinder-quobyte-da89769d-c26d-43c3-9246-0e060ecf5a87" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-quobyte-da89769d-c26d-43c3-9246-0e060ecf5a87" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Deleting offline snapshot da89769d-c26d-43c3-9246-0e060ecf5a87 of volume 8dc5cdad-d45c-421d-a538-13da0813d3d7 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] snapshot_file for this snap is: volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3d61eb-62e5-4a60-9ede-8f7f403dbd99]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:04 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 1073741824" returned: 0 in 0.499s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:04 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 Sep 04 06:06:04 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:04 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 Sep 04 06:06:04 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:04 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.193s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-107659521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13a89e5-0e89-4358-9c22-611ce5286c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddadca4e07e4dbc9de2c987c97bec00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:02Z,use_quota=True,user_id='eaca925a52414a0ea7f14a520691cf97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Creating volume b13a89e5-0e89-4358-9c22-611ce5286c6c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:06:04 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89e5-0e89-4358-9c22-611ce5286c6c 2147483648 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:04 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87" returned: 0 in 0.403s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dc5cdad-d45c-421d-a538-13da0813d3d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:06:04 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89e5-0e89-4358-9c22-611ce5286c6c 2147483648 Sep 04 06:06:04 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d4045c-1f49-4f96-bd3b-9eef463e0b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be0fc3b-5dd9-49fd-9fdf-e47315338794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b1d781-c0ff-4460-b421-e7ce20a17db8]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Volume volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 (7094adc7-8b7e-4cf0-8a70-e023d2cd12d3): created successfully Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be0fc3b-5dd9-49fd-9fdf-e47315338794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Flow 'volume_create_manager' (25c8e9c7-2534-478f-b2a1-eb660864c6c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:06:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0f5d6ccf-4b6e-4f9c-9729-366ec54ab718 tempest-VolumesActionsTest-1566475856 None] Created volume successfully. Sep 04 06:06:04 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 Sep 04 06:06:04 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:04 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89e5-0e89-4358-9c22-611ce5286c6c 2147483648" returned: 0 in 0.512s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89e5-0e89-4358-9c22-611ce5286c6c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:04 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89e5-0e89-4358-9c22-611ce5286c6c Sep 04 06:06:04 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:05 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7" returned: 0 in 0.604s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:05 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 Sep 04 06:06:05 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:05 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89e5-0e89-4358-9c22-611ce5286c6c" returned: 0 in 0.264s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8e973c-1a16-46b9-897d-3883629c9855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13a89e5-0e89-4358-9c22-611ce5286c6c', 'volume_size': 2}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb44e0d9-53d4-4dcf-902a-fffed697c817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Volume volume-b13a89e5-0e89-4358-9c22-611ce5286c6c (b13a89e5-0e89-4358-9c22-611ce5286c6c): created successfully Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb44e0d9-53d4-4dcf-902a-fffed697c817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Flow 'volume_create_manager' (1da822a5-08d0-4e00-a4d4-42044d2044f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:06:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0487f948-feed-4542-8b73-c4a512182643 tempest-VolumesCloneNegativeTest-1736178205 None] Created volume successfully. Sep 04 06:06:05 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:05 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87 Sep 04 06:06:05 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:05 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7.da89769d-c26d-43c3-9246-0e060ecf5a87" returned: 0 in 0.264s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-quobyte-da89769d-c26d-43c3-9246-0e060ecf5a87" released by "_delete_snapshot" :: held 1.750s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-quobyte-8dc5cdad-d45c-421d-a538-13da0813d3d7" released by "delete_snapshot" :: held 1.777s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Created reservations ['49e0da1a-3624-49b9-8128-13488ba8be95', 'c3308cc9-fba3-4d02-adba-29a77f0d0c18', 'd6a4d886-c1de-49e8-b324-bd17c3c127eb', 'c4a1ba82-b49f-483c-bd85-189601d6fc52'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:06:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Delete snapshot completed successfully. Sep 04 06:06:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-000c742f-5acb-4fc6-b3b0-48584e8bb2d9 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-da89769d-c26d-43c3-9246-0e060ecf5a87-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "cinder-8dc5cdad-d45c-421d-a538-13da0813d3d7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-8dc5cdad-d45c-421d-a538-13da0813d3d7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Acquiring lock "cinder-b13a89e5-0e89-4358-9c22-611ce5286c6c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "cinder-quobyte-8dc5cdad-d45c-421d-a538-13da0813d3d7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Lock "cinder-b13a89e5-0e89-4358-9c22-611ce5286c6c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-quobyte-8dc5cdad-d45c-421d-a538-13da0813d3d7" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ab7743-1126-462c-8a5a-5f956839f97c]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Acquiring lock "cinder-quobyte-b13a89e5-0e89-4358-9c22-611ce5286c6c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Lock "cinder-quobyte-b13a89e5-0e89-4358-9c22-611ce5286c6c" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a366bae-55e1-451f-b10b-6540ff5ec740]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89e5-0e89-4358-9c22-611ce5286c6c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:06 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 Sep 04 06:06:06 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:06 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89e5-0e89-4358-9c22-611ce5286c6c Sep 04 06:06:06 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:06 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:06 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7 Sep 04 06:06:06 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:06 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89e5-0e89-4358-9c22-611ce5286c6c" returned: 0 in 0.439s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89e5-0e89-4358-9c22-611ce5286c6c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:06 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89e5-0e89-4358-9c22-611ce5286c6c Sep 04 06:06:06 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:07 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dc5cdad-d45c-421d-a538-13da0813d3d7" returned: 0 in 0.349s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-quobyte-8dc5cdad-d45c-421d-a538-13da0813d3d7" released by "delete_volume" :: held 0.864s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:07 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89e5-0e89-4358-9c22-611ce5286c6c" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Lock "cinder-quobyte-b13a89e5-0e89-4358-9c22-611ce5286c6c" released by "delete_volume" :: held 0.826s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Created reservations ['f4770fd3-58ee-4d13-a03a-cae74ae11490', '10c4542e-f128-449b-8276-0c6a8d75b7e0', 'c65cdce4-f385-4cdb-bbb5-f1b0880187da', '2e95004e-7884-4801-b4e3-ccca95da94cf'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Created reservations ['331db98b-3b19-46bc-9097-8f98e2b29ada', 'fc0b84bb-73d7-4d16-9bbe-1770b183ef40', 'd9f3730e-fcb8-48e8-81dd-13f440fdc1fa', '66650da0-4122-414f-b5a7-9046ba12c67f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:07 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:06:07 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "cinder-29de27fd-7f80-49c5-a4f3-44c4671a7483-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-29de27fd-7f80-49c5-a4f3-44c4671a7483-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:07 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:06:07 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "cinder-quobyte-29de27fd-7f80-49c5-a4f3-44c4671a7483" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-quobyte-29de27fd-7f80-49c5-a4f3-44c4671a7483" acquired by "delete_volume" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[141e402a-a860-40e5-9128-35eb51f018d3]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:07 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.504s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:06:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Deleted volume successfully. Sep 04 06:06:07 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483 Sep 04 06:06:07 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a00cb8e-e3c6-4f16-bb63-d8daaaa2dc3c tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-8dc5cdad-d45c-421d-a538-13da0813d3d7-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:07 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.582s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:07 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:06:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Deleted volume successfully. Sep 04 06:06:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b1829830-9f9e-4679-969a-f95faecfeec4 tempest-VolumesCloneNegativeTest-1736178205 None] Lock "cinder-b13a89e5-0e89-4358-9c22-611ce5286c6c-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:08 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483" returned: 0 in 0.603s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:08 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483 Sep 04 06:06:08 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:08 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-29de27fd-7f80-49c5-a4f3-44c4671a7483" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-quobyte-29de27fd-7f80-49c5-a4f3-44c4671a7483" released by "delete_volume" :: held 1.045s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:08 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Created reservations ['453daa99-6c4e-48fb-b5c8-fece6e07944e', 'c547a859-6b81-4e2a-b0ba-f99e3e9a765a', 'eea0e37e-5455-43a3-b581-921c2eced866', 'f535b460-4867-47d6-940f-1bc5806a15b9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:06:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:06:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:06:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:08 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:06:08 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:09 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.396s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:09 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:06:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Deleted volume successfully. Sep 04 06:06:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a7ef438-21ef-4ee3-8964-ab2f4745da60 tempest-SnapshotDependencyTests-1433277344 None] Lock "cinder-29de27fd-7f80-49c5-a4f3-44c4671a7483-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:06:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Flow 'volume_create_manager' (2c767a80-b49a-4146-8bc2-7a8b5a20ce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:06:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fc85e0-b978-4077-a760-71b050f972c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fc85e0-b978-4077-a760-71b050f972c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-946132109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91fdc8a-c889-420b-a77c-e00b601a48ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3d07a9fbaa40d1951a1026882bdbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:13Z,use_quota=True,user_id='1eb6f72e98894d70a258533e95e51ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb94e9c2-9aa1-43d6-a6e5-c1dac37746fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb94e9c2-9aa1-43d6-a6e5-c1dac37746fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7861d5db-ce9e-4923-8d05-5088b7ce1747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:13 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 06:06:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7861d5db-ce9e-4923-8d05-5088b7ce1747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e91fdc8a-c889-420b-a77c-e00b601a48ad', 'volume_name': 'volume-e91fdc8a-c889-420b-a77c-e00b601a48ad', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5688ea-2ad1-4477-9675-72b78c113fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5688ea-2ad1-4477-9675-72b78c113fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcea0d8e-b7cf-4efb-8ccd-c1b167547a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Volume e91fdc8a-c889-420b-a77c-e00b601a48ad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e91fdc8a-c889-420b-a77c-e00b601a48ad', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 06:06:13 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Trying to clone e91fdc8a-c889-420b-a77c-e00b601a48ad from image e49bac44-c124-47bb-b839-5895be946aa9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 06:06:14 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 06:06:14 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Image download 20.69 MB at 20.69 MB/s Sep 04 06:06:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[95868f02-3148-49d9-9e82-f7c42ab505ce]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:14 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD Sep 04 06:06:14 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:14 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:14 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Temporary image e49bac44-c124-47bb-b839-5895be946aa9 is fetched for user 1eb6f72e98894d70a258533e95e51ab7. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 06:06:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1124f4a5-f01c-4f68-8e9e-7feb4342e3e6]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:15 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD Sep 04 06:06:15 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:15 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-946132109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91fdc8a-c889-420b-a77c-e00b601a48ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3d07a9fbaa40d1951a1026882bdbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:13Z,use_quota=True,user_id='1eb6f72e98894d70a258533e95e51ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Creating volume e91fdc8a-c889-420b-a77c-e00b601a48ad {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:06:15 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:15 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad 1073741824 Sep 04 06:06:15 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:15 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad 1073741824" returned: 0 in 0.602s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:16 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad Sep 04 06:06:16 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:16 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad" returned: 0 in 0.266s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:06:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:16 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Attempting download of e49bac44-c124-47bb-b839-5895be946aa9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}])) to volume e91fdc8a-c889-420b-a77c-e00b601a48ad. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 06:06:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb39bd16-b11e-4c4a-a50a-9526124cf3a1]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_izgqxgjv {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:16 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_izgqxgjv Sep 04 06:06:16 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8fdb650a-7627-495d-849f-84a89bae7fbd tempest-VolumesActionsTest-1566475856 None] Acquiring lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" by "attach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8fdb650a-7627-495d-849f-84a89bae7fbd tempest-VolumesActionsTest-1566475856 None] Lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" acquired by "attach_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8fdb650a-7627-495d-849f-84a89bae7fbd tempest-VolumesActionsTest-1566475856 None] Attaching volume 7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 to instance 360d26cc-1210-4b99-a893-1e5bfebea854 at mountpoint /dev/vdb on host None. Sep 04 06:06:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8fdb650a-7627-495d-849f-84a89bae7fbd tempest-VolumesActionsTest-1566475856 None] Attach volume completed successfully. Sep 04 06:06:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8fdb650a-7627-495d-849f-84a89bae7fbd tempest-VolumesActionsTest-1566475856 None] Lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" released by "attach_volume" :: held 0.145s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:16 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_izgqxgjv" returned: 0 in 0.469s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_izgqxgjv {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:17 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_izgqxgjv Sep 04 06:06:17 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b73c66d-54c1-4a32-8ae5-0a4904cfa3a3 tempest-VolumesActionsTest-1566475856 None] Acquiring lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3-detach_volume" by "detach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b73c66d-54c1-4a32-8ae5-0a4904cfa3a3 tempest-VolumesActionsTest-1566475856 None] Lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3b73c66d-54c1-4a32-8ae5-0a4904cfa3a3 tempest-VolumesActionsTest-1566475856 None] Detaching volume 7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 from instance 360d26cc-1210-4b99-a893-1e5bfebea854. Sep 04 06:06:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3b73c66d-54c1-4a32-8ae5-0a4904cfa3a3 tempest-VolumesActionsTest-1566475856 None] Detach volume completed successfully. Sep 04 06:06:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b73c66d-54c1-4a32-8ae5-0a4904cfa3a3 tempest-VolumesActionsTest-1566475856 None] Lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3-detach_volume" released by "detach_volume" :: held 0.140s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:17 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_izgqxgjv" returned: 1 in 0.460s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_izgqxgjv' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:06:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef44a28-4f6c-492a-8e9e-0766eef3d3c0]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:17 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD Sep 04 06:06:17 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:17 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:17 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] e49bac44-c124-47bb-b839-5895be946aa9 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 06:06:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:17 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad Sep 04 06:06:17 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:20 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad" returned: 0 in 2.358s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_k34ykuqodevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:06:20 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Converted 112.00 MB image at 47.47 MB/s Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:20 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad 1G Sep 04 06:06:20 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:20 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad 1G" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Downloaded image e49bac44-c124-47bb-b839-5895be946aa9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}])) to volume e91fdc8a-c889-420b-a77c-e00b601a48ad successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Temporary image e49bac44-c124-47bb-b839-5895be946aa9 for user 1eb6f72e98894d70a258533e95e51ab7 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Marking volume e91fdc8a-c889-420b-a77c-e00b601a48ad as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Copying metadata from image e49bac44-c124-47bb-b839-5895be946aa9 to e91fdc8a-c889-420b-a77c-e00b601a48ad. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Creating volume glance metadata for volume e91fdc8a-c889-420b-a77c-e00b601a48ad backed by image e49bac44-c124-47bb-b839-5895be946aa9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcea0d8e-b7cf-4efb-8ccd-c1b167547a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91fdc8a-c889-420b-a77c-e00b601a48ad', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f04f77-9269-4c58-9e13-31a500886665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Volume volume-e91fdc8a-c889-420b-a77c-e00b601a48ad (e91fdc8a-c889-420b-a77c-e00b601a48ad): created successfully Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f04f77-9269-4c58-9e13-31a500886665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Flow 'volume_create_manager' (2c767a80-b49a-4146-8bc2-7a8b5a20ce6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:06:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e4900b64-3b1f-410d-9814-e60069728aa2 tempest-VolumesExtendTest-1587606107 None] Created volume successfully. Sep 04 06:06:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-93f6ecf8-362b-4191-97ff-0ed8da00be51 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-93f6ecf8-362b-4191-97ff-0ed8da00be51 tempest-VolumesExtendTest-1587606107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab921a9c-10ff-4516-933d-8d21794ea92f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93f6ecf8-362b-4191-97ff-0ed8da00be51 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:21 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad Sep 04 06:06:21 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:22 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93f6ecf8-362b-4191-97ff-0ed8da00be51 tempest-VolumesExtendTest-1587606107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad" returned: 0 in 0.397s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93f6ecf8-362b-4191-97ff-0ed8da00be51 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad 2G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93f6ecf8-362b-4191-97ff-0ed8da00be51 tempest-VolumesExtendTest-1587606107 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad 2G" returned: 0 in 0.116s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-93f6ecf8-362b-4191-97ff-0ed8da00be51 tempest-VolumesExtendTest-1587606107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.546s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-93f6ecf8-362b-4191-97ff-0ed8da00be51 tempest-VolumesExtendTest-1587606107 None] Extend volume completed successfully. Sep 04 06:06:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "cinder-e91fdc8a-c889-420b-a77c-e00b601a48ad-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-e91fdc8a-c889-420b-a77c-e00b601a48ad-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "cinder-quobyte-e91fdc8a-c889-420b-a77c-e00b601a48ad" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-quobyte-e91fdc8a-c889-420b-a77c-e00b601a48ad" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac97d806-9d70-4827-b0ff-93f2653a4332]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:23 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad Sep 04 06:06:23 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:23 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad" returned: 0 in 0.599s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:23 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad Sep 04 06:06:23 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:24 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e91fdc8a-c889-420b-a77c-e00b601a48ad" returned: 0 in 0.508s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-quobyte-e91fdc8a-c889-420b-a77c-e00b601a48ad" released by "delete_volume" :: held 1.175s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:24 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Created reservations ['7d1070a3-3f1d-4b39-a522-39af3d7f4fa3', '9d42a295-199e-492c-a04f-090971a9e7be', 'afd5a01f-3a37-431b-bd23-61a2589d351d', 'd765aa6b-4c34-4a66-a7fd-dbd65825bc47'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:06:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:06:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:06:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:24 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:06:24 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:25 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:06:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Deleted volume successfully. Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b470278c-6cf9-42b9-9373-f4124ae167a7 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-e91fdc8a-c889-420b-a77c-e00b601a48ad-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:25 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:06:25 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:25 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:06:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Flow 'volume_create_manager' (6a257293-4f9b-40bb-a37f-d740b8a9655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff89557d-032d-4475-bd73-7c347451365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff89557d-032d-4475-bd73-7c347451365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-893811486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c7542d-dc89-43f2-a82b-f5983509827d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3d07a9fbaa40d1951a1026882bdbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:26Z,use_quota=True,user_id='1eb6f72e98894d70a258533e95e51ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b10ab3-a8dd-437a-8b41-24e29d7987cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b10ab3-a8dd-437a-8b41-24e29d7987cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6a1f26-af9a-4e66-bd61-2524ae196f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6a1f26-af9a-4e66-bd61-2524ae196f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c7542d-dc89-43f2-a82b-f5983509827d', 'volume_name': 'volume-48c7542d-dc89-43f2-a82b-f5983509827d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d385538a-aa16-470a-ae3b-791cf0a6eb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d385538a-aa16-470a-ae3b-791cf0a6eb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70568e73-abb1-40e8-a514-4408a6b40a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Volume 48c7542d-dc89-43f2-a82b-f5983509827d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c7542d-dc89-43f2-a82b-f5983509827d', 'volume_size': 1} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-893811486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c7542d-dc89-43f2-a82b-f5983509827d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3d07a9fbaa40d1951a1026882bdbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:26Z,use_quota=True,user_id='1eb6f72e98894d70a258533e95e51ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Creating volume 48c7542d-dc89-43f2-a82b-f5983509827d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:06:26 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:26 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d 1073741824 Sep 04 06:06:26 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:26 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d 1073741824" returned: 0 in 0.575s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:26 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d Sep 04 06:06:26 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:27 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d" returned: 0 in 0.302s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:06:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70568e73-abb1-40e8-a514-4408a6b40a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c7542d-dc89-43f2-a82b-f5983509827d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ac7b80-fc6d-4f36-9be2-17ad144aeae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:27 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Volume volume-48c7542d-dc89-43f2-a82b-f5983509827d (48c7542d-dc89-43f2-a82b-f5983509827d): created successfully Sep 04 06:06:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ac7b80-fc6d-4f36-9be2-17ad144aeae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Flow 'volume_create_manager' (6a257293-4f9b-40bb-a37f-d740b8a9655f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:06:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3af4a8b7-5a45-485d-9312-74394786202d tempest-VolumesExtendTest-1587606107 None] Created volume successfully. Sep 04 06:06:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-a6b90275-318d-4d11-a451-539d35a4fe3a req-a5f1e305-dd11-4239-b53f-fc1532303ada tempest-TestMinimumBasicScenario-1721251367 None] Terminate volume connection completed successfully. Sep 04 06:06:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-a6b90275-318d-4d11-a451-539d35a4fe3a req-a5f1e305-dd11-4239-b53f-fc1532303ada tempest-TestMinimumBasicScenario-1721251367 None] Deleting attachment e5013f82-be67-4ba6-be0f-80770c3b8e46. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:06:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] Creating offline snapshot 701e3bf9-d137-412b-b3ae-99c7cf12d1ea of volume 48c7542d-dc89-43f2-a82b-f5983509827d {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:06:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b161c4e0-ddd9-480d-8651-d50b691f8d80]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:29 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d Sep 04 06:06:29 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Acquiring lock "cinder-d62cd6c2-72ef-4201-92b7-2199e39ba317-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Lock "cinder-d62cd6c2-72ef-4201-92b7-2199e39ba317-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Acquiring lock "cinder-quobyte-d62cd6c2-72ef-4201-92b7-2199e39ba317" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Lock "cinder-quobyte-d62cd6c2-72ef-4201-92b7-2199e39ba317" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[254333b2-9fdd-4c2b-a8e5-14cbb27c4fe3]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d62cd6c2-72ef-4201-92b7-2199e39ba317 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:29 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d" returned: 0 in 0.609s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:29 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d62cd6c2-72ef-4201-92b7-2199e39ba317 Sep 04 06:06:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:29 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:29 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea 1G Sep 04 06:06:29 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:30 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d62cd6c2-72ef-4201-92b7-2199e39ba317" returned: 0 in 0.559s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d62cd6c2-72ef-4201-92b7-2199e39ba317 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:30 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d62cd6c2-72ef-4201-92b7-2199e39ba317 Sep 04 06:06:30 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:30 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea 1G" returned: 0 in 0.683s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c7542d-dc89-43f2-a82b-f5983509827d -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:30 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c7542d-dc89-43f2-a82b-f5983509827d -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea Sep 04 06:06:30 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:30 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d62cd6c2-72ef-4201-92b7-2199e39ba317" returned: 0 in 0.358s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Lock "cinder-quobyte-d62cd6c2-72ef-4201-92b7-2199e39ba317" released by "delete_volume" :: held 0.986s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Created reservations ['c773691f-09f2-4adc-9bbb-735b8955f25c', '319ff5c6-896e-47fd-9589-9f21f95bfe96', '341bda0e-ef2c-4b4c-9673-61650fb7275d', 'd596633f-ff9b-4cf9-8453-3138305d2287'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:30 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:06:30 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:30 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c7542d-dc89-43f2-a82b-f5983509827d -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:30 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea is being set with open permissions: ugo+rw Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:30 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea Sep 04 06:06:30 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eeaad2cc-79f7-456d-91ef-117742a48164 tempest-VolumesActionsTest-1566475856 None] Acquiring lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" by "attach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eeaad2cc-79f7-456d-91ef-117742a48164 tempest-VolumesActionsTest-1566475856 None] Lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" acquired by "attach_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:30 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:30 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:06:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Deleted volume successfully. Sep 04 06:06:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eeaad2cc-79f7-456d-91ef-117742a48164 tempest-VolumesActionsTest-1566475856 None] Attaching volume 7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 to instance 59b37043-f5fd-4009-b69c-7d753e27eff7 at mountpoint /dev/vdb on host None. Sep 04 06:06:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-39109dd4-3781-4cf5-9d4d-57bcc481c57f tempest-TestMinimumBasicScenario-1721251367 None] Lock "cinder-d62cd6c2-72ef-4201-92b7-2199e39ba317-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eeaad2cc-79f7-456d-91ef-117742a48164 tempest-VolumesActionsTest-1566475856 None] Attach volume completed successfully. Sep 04 06:06:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eeaad2cc-79f7-456d-91ef-117742a48164 tempest-VolumesActionsTest-1566475856 None] Lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" released by "attach_volume" :: held 0.134s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:31 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:31 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.info Sep 04 06:06:31 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-343761a5-bd6f-47c1-bf39-58d5141e8354 tempest-VolumesActionsTest-1566475856 None] Acquiring lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3-detach_volume" by "detach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-343761a5-bd6f-47c1-bf39-58d5141e8354 tempest-VolumesActionsTest-1566475856 None] Lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-343761a5-bd6f-47c1-bf39-58d5141e8354 tempest-VolumesActionsTest-1566475856 None] Detaching volume 7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 from instance 59b37043-f5fd-4009-b69c-7d753e27eff7. Sep 04 06:06:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-343761a5-bd6f-47c1-bf39-58d5141e8354 tempest-VolumesActionsTest-1566475856 None] Detach volume completed successfully. Sep 04 06:06:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-343761a5-bd6f-47c1-bf39-58d5141e8354 tempest-VolumesActionsTest-1566475856 None] Lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:31 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.info" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:31 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.info is being set with open permissions: ugo+rw Sep 04 06:06:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:31 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.info Sep 04 06:06:31 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:31 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.info" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.951s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3a49a178-fe64-48cb-bf3a-82b447453922 tempest-VolumesExtendTest-1587606107 None] Create snapshot completed successfully Sep 04 06:06:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49d5f5f0-f1c1-4635-aabf-e4af1f00e38a tempest-VolumesExtendTest-1587606107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49d5f5f0-f1c1-4635-aabf-e4af1f00e38a tempest-VolumesExtendTest-1587606107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c0c179-68b8-40cc-9267-5a8508a8f910]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49d5f5f0-f1c1-4635-aabf-e4af1f00e38a tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:32 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d Sep 04 06:06:32 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:32 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49d5f5f0-f1c1-4635-aabf-e4af1f00e38a tempest-VolumesExtendTest-1587606107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d" returned: 0 in 0.448s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49d5f5f0-f1c1-4635-aabf-e4af1f00e38a tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea 2G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49d5f5f0-f1c1-4635-aabf-e4af1f00e38a tempest-VolumesExtendTest-1587606107 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea 2G" returned: 0 in 0.174s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49d5f5f0-f1c1-4635-aabf-e4af1f00e38a tempest-VolumesExtendTest-1587606107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.679s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-49d5f5f0-f1c1-4635-aabf-e4af1f00e38a tempest-VolumesExtendTest-1587606107 None] Extend volume completed successfully. Sep 04 06:06:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "cinder-701e3bf9-d137-412b-b3ae-99c7cf12d1ea-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-701e3bf9-d137-412b-b3ae-99c7cf12d1ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "cinder-quobyte-48c7542d-dc89-43f2-a82b-f5983509827d" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-quobyte-48c7542d-dc89-43f2-a82b-f5983509827d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "cinder-quobyte-701e3bf9-d137-412b-b3ae-99c7cf12d1ea" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-quobyte-701e3bf9-d137-412b-b3ae-99c7cf12d1ea" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Deleting offline snapshot 701e3bf9-d137-412b-b3ae-99c7cf12d1ea of volume 48c7542d-dc89-43f2-a82b-f5983509827d {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:06:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] snapshot_file for this snap is: volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:06:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2079e3-83ad-4998-9088-af91f4598028]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:33 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea Sep 04 06:06:33 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:34 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c7542d-dc89-43f2-a82b-f5983509827d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:06:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[166bca54-37fc-4baf-b402-de090d1d6e28]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:34 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d Sep 04 06:06:34 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:34 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:34 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea Sep 04 06:06:34 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:35 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea" returned: 0 in 0.513s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:35 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea Sep 04 06:06:35 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:35 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d.701e3bf9-d137-412b-b3ae-99c7cf12d1ea" returned: 0 in 0.284s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-quobyte-701e3bf9-d137-412b-b3ae-99c7cf12d1ea" released by "_delete_snapshot" :: held 1.699s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-quobyte-48c7542d-dc89-43f2-a82b-f5983509827d" released by "delete_snapshot" :: held 1.731s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Created reservations ['126a645b-8a06-4212-9b9b-018f8cfbe8d0', 'd0bb7659-9bfd-4032-8b0f-3ac555bce481', '6be862e7-3628-48fc-bcc4-fd3aa89fc8c9', '140fbd03-1fd4-436a-9feb-6ff7a6bd69c8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:06:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Delete snapshot completed successfully. Sep 04 06:06:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e8caa4-3ee5-4b1d-bf8d-1b08dc303538 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-701e3bf9-d137-412b-b3ae-99c7cf12d1ea-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "cinder-48c7542d-dc89-43f2-a82b-f5983509827d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-48c7542d-dc89-43f2-a82b-f5983509827d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "cinder-quobyte-48c7542d-dc89-43f2-a82b-f5983509827d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-quobyte-48c7542d-dc89-43f2-a82b-f5983509827d" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e876d45-7869-4923-820f-ffc63d0a0589]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:36 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d Sep 04 06:06:36 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe648887-f5db-404c-985e-a926a07a124b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:36 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 Sep 04 06:06:36 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:36 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d" returned: 0 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:36 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d Sep 04 06:06:36 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:36 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-48c7542d-dc89-43f2-a82b-f5983509827d" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:36 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-quobyte-48c7542d-dc89-43f2-a82b-f5983509827d" released by "delete_volume" :: held 0.702s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0ef85c-42f1-46e2-b524-57ba542dda90]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Created reservations ['feae657c-e2fc-4fa4-8545-e8d26c87b1ed', '13865955-9bc8-40ea-8835-9a32aed10065', '6234384c-233e-4de4-b888-341c56e5b090', '464b4210-d8d8-47c0-a612-2a1d6929445f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:06:36 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:06:36 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:36 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:06:36 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:37 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.288s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:06:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Deleted volume successfully. Sep 04 06:06:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65d8b7de-2a99-4864-9660-5af28ab72678 tempest-VolumesExtendTest-1587606107 None] Lock "cinder-48c7542d-dc89-43f2-a82b-f5983509827d-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:06:37 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" returned: 0 in 0.460s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.dfc8ff05-a200-4c40-b388-44952e20c5b65m88zwhv.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:37 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.dfc8ff05-a200-4c40-b388-44952e20c5b65m88zwhv.img Sep 04 06:06:37 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:42 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.dfc8ff05-a200-4c40-b388-44952e20c5b65m88zwhv.img" returned: 0 in 5.147s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[66efa46d-c48f-482e-8b25-d4c520c991b9]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:06:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:06:42 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 Sep 04 06:06:42 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:06:43 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 04 06:06:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" returned: 0 in 0.595s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:06:43 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.dfc8ff05-a200-4c40-b388-44952e20c5b65m88zwhv.img {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:06:43 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] Converted 1024.00 MB image at 198.91 MB/s Sep 04 06:06:43 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=111,cinder:UPDATE=122,cinder:DELETE=9,cinder:INSERT=30 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:06:43 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=100,cinder:UPDATE=112,cinder:INSERT=40,cinder:DELETE=8 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:06:43 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] dfc8ff05-a200-4c40-b388-44952e20c5b6 was raw, no need to convert to raw {{(pid=87132) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 04 06:06:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:06:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Flow 'volume_create_manager' (2a9783e6-7f53-4c9d-8226-41b0e78a1421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:06:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f2b62a-c69d-4db8-ba5d-297001734af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f2b62a-c69d-4db8-ba5d-297001734af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-223512538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b472519-8eb6-4d40-b3b0-4c40aa197d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b14960707e40e2831b58abc1a6c188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:55Z,use_quota=True,user_id='cc532e56ad194d77ac2654d6ce35fb8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c08131e-c85b-4b70-92c1-ef345862458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c08131e-c85b-4b70-92c1-ef345862458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981734bc-c5b4-451e-9e1f-76c6f597edf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981734bc-c5b4-451e-9e1f-76c6f597edf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b472519-8eb6-4d40-b3b0-4c40aa197d40', 'volume_name': 'volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c103aff2-a2f0-4765-b432-efe47856ef02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c103aff2-a2f0-4765-b432-efe47856ef02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:06:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc4b1f3-2c11-47a8-a1f7-8afcc48cc6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:06:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Volume 7b472519-8eb6-4d40-b3b0-4c40aa197d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40', 'volume_size': 1} Sep 04 06:06:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:05 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.763s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] Uploaded volume to glance image-id: dfc8ff05-a200-4c40-b388-44952e20c5b6. {{(pid=87132) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.958s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-223512538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b472519-8eb6-4d40-b3b0-4c40aa197d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b14960707e40e2831b58abc1a6c188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:55Z,use_quota=True,user_id='cc532e56ad194d77ac2654d6ce35fb8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Creating volume 7b472519-8eb6-4d40-b3b0-4c40aa197d40 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:07:07 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:07 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 1073741824 Sep 04 06:07:07 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7d11f9d1-380c-4c40-bb5b-c52f8ec1648d tempest-VolumesActionsTest-1566475856 None] Copy volume to image completed successfully. Sep 04 06:07:07 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 1073741824" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:07 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 Sep 04 06:07:07 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:07 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc4b1f3-2c11-47a8-a1f7-8afcc48cc6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ced8df8-57f8-4c97-bc61-ff1630f8ba60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Volume volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 (7b472519-8eb6-4d40-b3b0-4c40aa197d40): created successfully Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ced8df8-57f8-4c97-bc61-ff1630f8ba60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Flow 'volume_create_manager' (2a9783e6-7f53-4c9d-8226-41b0e78a1421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:07:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2a4b48e3-a679-4ffb-941c-d91e602fb731 tempest-VolumesSnapshotTestJSON-26079179 None] Created volume successfully. Sep 04 06:07:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3836e4-4b35-423e-86ed-6d41a1e1b8c1]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:08 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 Sep 04 06:07:08 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:09 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" returned: 0 in 0.475s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2ad021-2e85-4933-ad25-bacff07321fa]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:09 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 Sep 04 06:07:09 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:09 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:09 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img Sep 04 06:07:09 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:14 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img" returned: 0 in 4.537s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c259435-6dac-4cfa-84aa-09a645d1a970]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:14 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 Sep 04 06:07:14 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:14 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" returned: 0 in 0.528s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:14 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:07:14 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Converted 1024.00 MB image at 225.63 MB/s Sep 04 06:07:14 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] 508a23d1-ec5a-4469-8991-af8d6099c971 was raw, converting to qcow2 {{(pid=87132) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 04 06:07:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[824f6a5f-d944-4877-a76f-02d0b266e9e4]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:14 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img Sep 04 06:07:14 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:15 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img" returned: 0 in 0.344s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:15 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img Sep 04 06:07:15 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:15 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img" returned: 1 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:07:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img /opt/stack/data/cinder/conversion/vol_upload_uuqr0jxm {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:15 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img /opt/stack/data/cinder/conversion/vol_upload_uuqr0jxm Sep 04 06:07:15 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:15 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img /opt/stack/data/cinder/conversion/vol_upload_uuqr0jxm" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:15 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Image conversion details: src /opt/stack/data/cinder/conversion/7094adc7-8b7e-4cf0-8a70-e023d2cd12d3.temp_image.508a23d1-ec5a-4469-8991-af8d6099c971e0veohij.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_uuqr0jxm {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:07:15 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 04 06:07:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cb3482-64aa-4efb-811c-a2643183d37a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uuqr0jxm {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:15 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uuqr0jxm Sep 04 06:07:15 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:16 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uuqr0jxm" returned: 0 in 0.328s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Uploaded volume to glance image-id: 508a23d1-ec5a-4469-8991-af8d6099c971. {{(pid=87132) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 06:07:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.524s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] Creating offline snapshot 43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb of volume 7b472519-8eb6-4d40-b3b0-4c40aa197d40 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:07:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-199d03f2-b26b-4921-8f92-69939f7a9af2 tempest-VolumesActionsTest-1566475856 None] Copy volume to image completed successfully. Sep 04 06:07:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3977631-5c61-4f4b-a329-2f1874cf1930]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:17 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 Sep 04 06:07:17 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Flow 'volume_create_manager' (692d96f9-93db-4dd2-80d6-c1c8c0a23332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8642ba-7b29-467a-8450-6c251074c7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8642ba-7b29-467a-8450-6c251074c7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-282612913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d996f30f459e4748bfe9f533a49b82f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:18Z,use_quota=True,user_id='95284c6d38644293acf1679cdcd488c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebab675-f318-42e1-8fe2-90c04b941d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebab675-f318-42e1-8fe2-90c04b941d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82636fa7-9513-4bf5-bb8f-096b9aa518a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82636fa7-9513-4bf5-bb8f-096b9aa518a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b', 'volume_name': 'volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdfbb2e-e5e4-4e1a-bf43-dfdc6b958007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdfbb2e-e5e4-4e1a-bf43-dfdc6b958007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491d321d-241c-4bfe-9a47-d38174698c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Volume c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b', 'volume_size': 1} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:18 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40" returned: 0 in 0.384s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:18 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb 1G Sep 04 06:07:18 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:18 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb 1G" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:18 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb Sep 04 06:07:18 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:18 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb" returned: 0 in 0.315s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:18 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb is being set with open permissions: ugo+rw Sep 04 06:07:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:19 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb Sep 04 06:07:19 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Acquiring lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Acquiring lock "cinder-quobyte-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Lock "cinder-quobyte-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a7099d-3314-4ce6-97e9-b25038d0481a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:19 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 Sep 04 06:07:19 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:19 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:19 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.info Sep 04 06:07:19 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:19 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:19 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.info" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:19 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.info is being set with open permissions: ugo+rw Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:19 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3 Sep 04 06:07:19 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:19 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.info Sep 04 06:07:19 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:19 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Lock "cinder-quobyte-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3" released by "delete_volume" :: held 0.663s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:07:19 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.info" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.570s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-282612913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d996f30f459e4748bfe9f533a49b82f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:18Z,use_quota=True,user_id='95284c6d38644293acf1679cdcd488c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Creating volume c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:07:19 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:19 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b 1073741824 Sep 04 06:07:19 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Created reservations ['1e38ed62-8d26-422e-a69f-d8b4c8f0a8f2', 'bc5cc35d-b881-4934-9227-a43aac2c4c62', 'fbc59ef3-5d2f-4e9d-8e17-b18272d18f03', '57700112-3e30-41a5-9511-42b3c150467a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:07:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e2174893-d4e0-4bfa-b426-82de66ef3666 tempest-VolumesSnapshotTestJSON-26079179 None] Create snapshot completed successfully Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:19 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:07:19 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:20 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:20 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:07:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Deleted volume successfully. Sep 04 06:07:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e7eb142-3d1e-441f-b7cf-4e7c70bfd251 tempest-VolumesActionsTest-1566475856 None] Lock "cinder-7094adc7-8b7e-4cf0-8a70-e023d2cd12d3-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:07:20 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b 1073741824" returned: 0 in 0.492s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:20 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b Sep 04 06:07:20 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:20 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b" returned: 0 in 0.259s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:07:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491d321d-241c-4bfe-9a47-d38174698c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78aff558-c83d-4add-952a-315d5a464131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Volume volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b (c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b): created successfully Sep 04 06:07:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78aff558-c83d-4add-952a-315d5a464131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Flow 'volume_create_manager' (692d96f9-93db-4dd2-80d6-c1c8c0a23332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:07:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-98686f7b-1f30-4f80-8d4d-25ff2715f6f9 tempest-TestImageHashVerification-1597987712 None] Created volume successfully. Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-7b472519-8eb6-4d40-b3b0-4c40aa197d40" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-7b472519-8eb6-4d40-b3b0-4c40aa197d40" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Deleting offline snapshot 43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb of volume 7b472519-8eb6-4d40-b3b0-4c40aa197d40 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] snapshot_file for this snap is: volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[df349703-86d2-41ec-8a89-444496f809bb]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:21 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb Sep 04 06:07:21 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:21 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb" returned: 0 in 0.464s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb37731-c22c-41d4-b546-1cb7507085e4]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:21 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 Sep 04 06:07:21 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:22 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:22 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb Sep 04 06:07:22 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caa3f50-0839-447a-8125-a70172df9d3e]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:22 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b Sep 04 06:07:22 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:22 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:22 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb Sep 04 06:07:22 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:22 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b" returned: 0 in 0.425s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1c03c5-0128-4767-9b0e-a6bd6bd70268]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:23 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40.43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:23 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b Sep 04 06:07:23 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb" released by "_delete_snapshot" :: held 1.843s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:07:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-7b472519-8eb6-4d40-b3b0-4c40aa197d40" released by "delete_snapshot" :: held 1.873s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:07:23 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Created reservations ['05e97921-7ea6-429f-8ac5-83a99d6773a5', 'afbdec6e-4e3d-4661-9273-a2cef5da9734', '073815fe-e595-4f9e-a480-3f20f4d6bddd', 'f1db08c7-a189-4f9f-8ddf-71f8554a039e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:07:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Delete snapshot completed successfully. Sep 04 06:07:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b99f185d-6403-4791-9048-900ec58e5788 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-43f594ba-d3e3-46b5-bdc4-d3ea5a3f56cb-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:07:23 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b" returned: 0 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b /opt/stack/data/cinder/conversion/c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b.temp_image.d1c279cb-556f-4d86-ace7-b66d5659e1e4m65kq039.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:23 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b /opt/stack/data/cinder/conversion/c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b.temp_image.d1c279cb-556f-4d86-ace7-b66d5659e1e4m65kq039.img Sep 04 06:07:23 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:07:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Flow 'volume_create_manager' (6d63c52c-478f-4208-b6a0-e98c69013839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:07:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de2d7c4-e663-48e4-b83b-9a366a9fa209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de2d7c4-e663-48e4-b83b-9a366a9fa209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-183379413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad69bba5-b7e2-4df5-8391-c3a48400495f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b14960707e40e2831b58abc1a6c188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:24Z,use_quota=True,user_id='cc532e56ad194d77ac2654d6ce35fb8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35fe67b-6090-497b-8916-20c2ec858e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35fe67b-6090-497b-8916-20c2ec858e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2dd403-6b5e-4e2e-9078-a6a3e3f359ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2dd403-6b5e-4e2e-9078-a6a3e3f359ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad69bba5-b7e2-4df5-8391-c3a48400495f', 'volume_name': 'volume-ad69bba5-b7e2-4df5-8391-c3a48400495f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28285c5-cb79-43ef-a833-492c966a090a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28285c5-cb79-43ef-a833-492c966a090a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ac443e-ea3b-4a53-ab22-f47cc1acb3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Volume ad69bba5-b7e2-4df5-8391-c3a48400495f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad69bba5-b7e2-4df5-8391-c3a48400495f', 'volume_size': 1} Sep 04 06:07:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:07:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:07:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:07:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:25 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:07:25 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:25 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.578s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:07:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:07:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:07:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:07:28 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b /opt/stack/data/cinder/conversion/c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b.temp_image.d1c279cb-556f-4d86-ace7-b66d5659e1e4m65kq039.img" returned: 0 in 5.079s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4ef8ea-9a3a-4011-b08d-d2cb2592d43e]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:28 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b Sep 04 06:07:28 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:29 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b" returned: 0 in 0.606s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:29 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/conversion/c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b.temp_image.d1c279cb-556f-4d86-ace7-b66d5659e1e4m65kq039.img {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:07:29 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] Converted 1024.00 MB image at 201.59 MB/s Sep 04 06:07:29 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] d1c279cb-556f-4d86-ace7-b66d5659e1e4 was raw, no need to convert to raw {{(pid=87132) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 04 06:07:39 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=29,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:07:39 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=22,cinder:SELECT=27,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:07:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.466s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] Uploaded volume to glance image-id: d1c279cb-556f-4d86-ace7-b66d5659e1e4. {{(pid=87132) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 06:07:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.128s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-183379413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad69bba5-b7e2-4df5-8391-c3a48400495f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b14960707e40e2831b58abc1a6c188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:24Z,use_quota=True,user_id='cc532e56ad194d77ac2654d6ce35fb8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:07:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Creating volume ad69bba5-b7e2-4df5-8391-c3a48400495f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:07:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:07:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:07:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:07:50 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:07:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:50 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f 1073741824 Sep 04 06:07:50 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7aa7ad84-b301-4331-afd6-fc2287d1f941 tempest-TestImageHashVerification-1597987712 None] Copy volume to image completed successfully. Sep 04 06:07:51 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f 1073741824" returned: 0 in 0.427s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:51 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f Sep 04 06:07:51 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:51 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f" returned: 0 in 0.269s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:07:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ac443e-ea3b-4a53-ab22-f47cc1acb3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad69bba5-b7e2-4df5-8391-c3a48400495f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66a9f87-ba60-4750-9978-dc273a986925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Volume volume-ad69bba5-b7e2-4df5-8391-c3a48400495f (ad69bba5-b7e2-4df5-8391-c3a48400495f): created successfully Sep 04 06:07:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66a9f87-ba60-4750-9978-dc273a986925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Flow 'volume_create_manager' (6d63c52c-478f-4208-b6a0-e98c69013839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:07:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ca3ef76f-0afe-4fad-92d0-5ef9bdd7036a tempest-VolumesSnapshotTestJSON-26079179 None] Created volume successfully. Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Acquiring lock "cinder-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Lock "cinder-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Acquiring lock "cinder-quobyte-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Lock "cinder-quobyte-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf262a0-893b-4f55-94a9-37ca54e04123]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:52 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b Sep 04 06:07:52 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:52 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b" returned: 0 in 0.434s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:52 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b Sep 04 06:07:52 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] Creating offline snapshot c38bfe96-ddaf-4094-ab75-0136dd004daf of volume ad69bba5-b7e2-4df5-8391-c3a48400495f {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[515e10d0-b9c0-4404-8784-8108e782d0bd]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:53 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f Sep 04 06:07:53 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:53 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b" returned: 0 in 0.274s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Lock "cinder-quobyte-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b" released by "delete_volume" :: held 0.753s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Created reservations ['80083467-b642-48fa-b12f-31d314356673', 'c65e1376-cfa6-469f-8d02-cc65b09bf983', '5f9d00f9-26be-4c8a-ac98-12b234de20b1', '3c177b85-e186-4321-af5c-4dc332858eee'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:53 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:07:53 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:53 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f" returned: 0 in 0.407s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:53 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf 1G Sep 04 06:07:53 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:53 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.290s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:07:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Deleted volume successfully. Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b6c9990-6266-43ee-a916-ef8ccb557e7c tempest-TestImageHashVerification-1597987712 None] Lock "cinder-c0c8b8ad-489f-44d0-b6f1-e3d9d9a9603b-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:07:53 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf 1G" returned: 0 in 0.534s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad69bba5-b7e2-4df5-8391-c3a48400495f -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:53 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad69bba5-b7e2-4df5-8391-c3a48400495f -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf Sep 04 06:07:53 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:54 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad69bba5-b7e2-4df5-8391-c3a48400495f -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:54 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf is being set with open permissions: ugo+rw Sep 04 06:07:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:54 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf Sep 04 06:07:54 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:54 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:54 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.info Sep 04 06:07:54 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:54 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.info" returned: 0 in 0.326s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:54 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.info is being set with open permissions: ugo+rw Sep 04 06:07:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:54 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.info Sep 04 06:07:54 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:07:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Flow 'volume_create_manager' (cf2df04e-b19f-4e11-bc8a-50f53fca904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:07:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333494a3-9f5f-45b2-aa0f-2257b2bf276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333494a3-9f5f-45b2-aa0f-2257b2bf276a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-725551570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d2f718-82fe-404e-82b8-ccc9a7f751e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47031a10eb2546d48af1bb25dcbe1934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:55Z,use_quota=True,user_id='cc21ea4e3be743febea66e229d901ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fbde9e-a0e8-4352-ab79-50dd3f42d84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fbde9e-a0e8-4352-ab79-50dd3f42d84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee651cfa-abb1-49a1-8a08-e9a3161abd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 06:07:55 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.info" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f9c3338c-bea9-402b-815c-90d5ffc42404 tempest-VolumesSnapshotTestJSON-26079179 None] Create snapshot completed successfully Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee651cfa-abb1-49a1-8a08-e9a3161abd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73d2f718-82fe-404e-82b8-ccc9a7f751e9', 'volume_name': 'volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331582bc-d28f-4660-be08-9aa8deb10f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331582bc-d28f-4660-be08-9aa8deb10f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42fc8b54-56b8-4d9a-9382-069ee2b6d1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Volume 73d2f718-82fe-404e-82b8-ccc9a7f751e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Trying to clone 73d2f718-82fe-404e-82b8-ccc9a7f751e9 from image e49bac44-c124-47bb-b839-5895be946aa9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 06:07:55 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Image download 20.69 MB at 20.69 MB/s Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c3e727-5402-4855-ad08-7302aac7f9f8]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:55 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD Sep 04 06:07:55 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:56 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Temporary image e49bac44-c124-47bb-b839-5895be946aa9 is fetched for user cc21ea4e3be743febea66e229d901ca3. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbae080a-1f75-42c3-8865-4377995d9696]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:56 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD Sep 04 06:07:56 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:56 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD" returned: 0 in 0.524s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-725551570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d2f718-82fe-404e-82b8-ccc9a7f751e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47031a10eb2546d48af1bb25dcbe1934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:55Z,use_quota=True,user_id='cc21ea4e3be743febea66e229d901ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Creating volume 73d2f718-82fe-404e-82b8-ccc9a7f751e9 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:07:56 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:56 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 1073741824 Sep 04 06:07:56 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Flow 'volume_create_manager' (f26b731c-5bbc-4566-9749-e00729e15233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8ff58d-58f5-4769-b6a5-4e90fda57047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8ff58d-58f5-4769-b6a5-4e90fda57047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1549026219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b85eed-1a0d-47d0-acee-5e1c70f21c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b14960707e40e2831b58abc1a6c188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c38bfe96-ddaf-4094-ab75-0136dd004daf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:57Z,use_quota=True,user_id='cc532e56ad194d77ac2654d6ce35fb8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac251717-c645-466c-b558-cc7615061a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac251717-c645-466c-b558-cc7615061a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3433b09e-126b-4fc4-8926-1a3f3168fbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3433b09e-126b-4fc4-8926-1a3f3168fbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5b85eed-1a0d-47d0-acee-5e1c70f21c2f', 'volume_name': 'volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f', 'volume_size': 2, 'snapshot_id': 'c38bfe96-ddaf-4094-ab75-0136dd004daf'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f35d3bf-d088-4b9b-aa90-de263d3d1583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f35d3bf-d088-4b9b-aa90-de263d3d1583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8903d30c-6d33-4fa9-b5f1-ccc54045cfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:07:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Volume a5b85eed-1a0d-47d0-acee-5e1c70f21c2f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f', 'volume_size': 2, 'snapshot_id': 'c38bfe96-ddaf-4094-ab75-0136dd004daf'} Sep 04 06:07:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:57 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 1073741824" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:57 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 Sep 04 06:07:57 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:57 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9" returned: 0 in 0.254s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.552s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-c38bfe96-ddaf-4094-ab75-0136dd004daf-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-c38bfe96-ddaf-4094-ab75-0136dd004daf-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Creating volume a5b85eed-1a0d-47d0-acee-5e1c70f21c2f from snapshot c38bfe96-ddaf-4094-ab75-0136dd004daf {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Attempting download of e49bac44-c124-47bb-b839-5895be946aa9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}])) to volume 73d2f718-82fe-404e-82b8-ccc9a7f751e9. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] snapshot: c38bfe96-ddaf-4094-ab75-0136dd004daf, volume: a5b85eed-1a0d-47d0-acee-5e1c70f21c2f, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8079f95-69cf-4898-8f5d-d7d4321c0631]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b04841-0e17-40ee-99da-1a7971d06a3e]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_oafx15h4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:57 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_oafx15h4 Sep 04 06:07:57 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:57 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf Sep 04 06:07:57 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:58 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_oafx15h4" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_oafx15h4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:58 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf" returned: 0 in 0.571s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad69bba5-b7e2-4df5-8391-c3a48400495f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d35f0-6cf6-4ac1-9f74-952f3c8beced]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:58 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_oafx15h4 Sep 04 06:07:58 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:58 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f Sep 04 06:07:58 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:58 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_oafx15h4" returned: 1 in 0.448s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e49bac44-c124-47bb-b839-5895be946aa9_oafx15h4' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc300b7-2843-45b0-ba59-689720b7dec8]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:58 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD Sep 04 06:07:58 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:58 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f" returned: 0 in 0.445s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] will copy from snapshot at /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Path /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:58 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f Sep 04 06:07:58 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:07:58 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] e49bac44-c124-47bb-b839-5895be946aa9 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 06:07:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:07:58 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 Sep 04 06:07:58 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:02 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9" returned: 0 in 3.915s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:02 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e49bac44-c124-47bb-b839-5895be946aa9_s1dxk142devstack@QuobyteHD, size 112.00 MB, duration 3.92 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:08:02 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Converted 112.00 MB image at 28.60 MB/s Sep 04 06:08:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:02 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 1G Sep 04 06:08:02 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:03 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 1G" returned: 0 in 0.791s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:03 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Downloaded image e49bac44-c124-47bb-b839-5895be946aa9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}])) to volume 73d2f718-82fe-404e-82b8-ccc9a7f751e9 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 06:08:03 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Temporary image e49bac44-c124-47bb-b839-5895be946aa9 for user cc21ea4e3be743febea66e229d901ca3 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 06:08:03 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Marking volume 73d2f718-82fe-404e-82b8-ccc9a7f751e9 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 06:08:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Copying metadata from image e49bac44-c124-47bb-b839-5895be946aa9 to 73d2f718-82fe-404e-82b8-ccc9a7f751e9. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 06:08:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Creating volume glance metadata for volume 73d2f718-82fe-404e-82b8-ccc9a7f751e9 backed by image e49bac44-c124-47bb-b839-5895be946aa9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 06:08:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42fc8b54-56b8-4d9a-9382-069ee2b6d1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9', 'volume_size': 1, 'image_id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e49bac44-c124-47bb-b839-5895be946aa9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d0e9e9bc1d448248127058de88147de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e49bac44-c124-47bb-b839-5895be946aa9', 'created_at': datetime.datetime(2026, 9, 4, 3, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 49, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e49bac44-c124-47bb-b839-5895be946aa9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a78fa26-955e-42ce-b6e7-2868d6ef198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Volume volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 (73d2f718-82fe-404e-82b8-ccc9a7f751e9): created successfully Sep 04 06:08:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a78fa26-955e-42ce-b6e7-2868d6ef198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Flow 'volume_create_manager' (cf2df04e-b19f-4e11-bc8a-50f53fca904e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7fceba7b-cbf1-454c-8e6c-fb813978eded tempest-TestShelveInstance-15420912 None] Created volume successfully. Sep 04 06:08:04 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" returned: 0 in 5.574s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:04 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:08:04 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Converted 1024.00 MB image at 183.66 MB/s Sep 04 06:08:04 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f is being set with open permissions: ugo+rw Sep 04 06:08:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:04 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f Sep 04 06:08:04 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:04 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" returned: 0 in 0.261s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" released by "_copy_volume_from_snapshot" :: held 7.019s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-c38bfe96-ddaf-4094-ab75-0136dd004daf-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" released by "_create_volume_from_snapshot" :: held 7.098s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.135s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8903d30c-6d33-4fa9-b5f1-ccc54045cfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f', 'volume_size': 2, 'snapshot_id': 'c38bfe96-ddaf-4094-ab75-0136dd004daf'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d996588-c9c2-47aa-a89f-19ce8ee3be22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Volume volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f (a5b85eed-1a0d-47d0-acee-5e1c70f21c2f): created successfully Sep 04 06:08:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d996588-c9c2-47aa-a89f-19ce8ee3be22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Flow 'volume_create_manager' (f26b731c-5bbc-4566-9749-e00729e15233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-052ee182-181e-428d-a659-affabfc6cb61 tempest-VolumesSnapshotTestJSON-26079179 None] Created volume successfully. Sep 04 06:08:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d7c56-d6d3-4455-a5c5-69caa21b3ff9]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:06 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f Sep 04 06:08:06 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:06 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" returned: 0 in 0.441s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:06 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f Sep 04 06:08:06 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:06 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" returned: 0 in 0.308s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f" released by "delete_volume" :: held 0.823s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:06 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Created reservations ['69c2cc60-c593-4f29-9e7c-69ed1fc524f8', 'c07299a0-b543-4da1-9a1f-5c10f6f2b1a0', '9a53321d-fbdc-42b8-9a9c-80d8c090c63c', '28241dc4-dc02-455b-8214-13e7e43a9a82'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:07 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:07 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-c38bfe96-ddaf-4094-ab75-0136dd004daf-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-c38bfe96-ddaf-4094-ab75-0136dd004daf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-ad69bba5-b7e2-4df5-8391-c3a48400495f" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-ad69bba5-b7e2-4df5-8391-c3a48400495f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-c38bfe96-ddaf-4094-ab75-0136dd004daf" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-c38bfe96-ddaf-4094-ab75-0136dd004daf" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Deleting offline snapshot c38bfe96-ddaf-4094-ab75-0136dd004daf of volume ad69bba5-b7e2-4df5-8391-c3a48400495f {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] snapshot_file for this snap is: volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c8f62f-9fea-41d4-8cc9-0f424441ac6b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:07 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.477s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Deleted volume successfully. Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-67efe254-4159-41c5-8ec0-a4d7e1b706f8 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-a5b85eed-1a0d-47d0-acee-5e1c70f21c2f-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:07 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf Sep 04 06:08:07 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-47ad2f93-d123-47a5-a510-39976b8a22ff req-6f245b26-5f3a-4105-9863-4812d8f4f914 tempest-TestShelveInstance-15420912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-47ad2f93-d123-47a5-a510-39976b8a22ff req-6f245b26-5f3a-4105-9863-4812d8f4f914 tempest-TestShelveInstance-15420912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-47ad2f93-d123-47a5-a510-39976b8a22ff req-6f245b26-5f3a-4105-9863-4812d8f4f914 tempest-TestShelveInstance-15420912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-47ad2f93-d123-47a5-a510-39976b8a22ff req-6f245b26-5f3a-4105-9863-4812d8f4f914 tempest-TestShelveInstance-15420912 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee85dec3-8980-4b9b-8b0c-fe6aa1e4b4b8', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:08:08 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf" returned: 0 in 0.582s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad69bba5-b7e2-4df5-8391-c3a48400495f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:08:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5025f7-f868-4f05-a231-aecdbd05dcdb]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-47ad2f93-d123-47a5-a510-39976b8a22ff req-6f245b26-5f3a-4105-9863-4812d8f4f914 tempest-TestShelveInstance-15420912 None] attachment_update completed successfully. Sep 04 06:08:08 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f Sep 04 06:08:08 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:08 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f" returned: 0 in 0.646s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:08 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf Sep 04 06:08:08 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:09 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:09 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf Sep 04 06:08:09 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:09 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f.c38bfe96-ddaf-4094-ab75-0136dd004daf" returned: 0 in 0.293s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-c38bfe96-ddaf-4094-ab75-0136dd004daf" released by "_delete_snapshot" :: held 2.098s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-ad69bba5-b7e2-4df5-8391-c3a48400495f" released by "delete_snapshot" :: held 2.140s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:09 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Created reservations ['96a0debf-d448-4eda-a15c-b763916a153b', 'ae3b0640-88da-4f38-bf88-3076afc0c98f', 'ee8f8f37-98a6-4f1e-9af9-cf833a987b2e', 'b019fea7-26f1-470b-b98a-104599430423'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Delete snapshot completed successfully. Sep 04 06:08:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd31db4d-af3d-4343-af36-9501d41064f9 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-c38bfe96-ddaf-4094-ab75-0136dd004daf-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-ad69bba5-b7e2-4df5-8391-c3a48400495f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-ad69bba5-b7e2-4df5-8391-c3a48400495f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-ad69bba5-b7e2-4df5-8391-c3a48400495f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-ad69bba5-b7e2-4df5-8391-c3a48400495f" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0268ce1f-aa26-44b5-8d42-31d31f7fd8d8]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:11 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f Sep 04 06:08:11 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:11 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f" returned: 0 in 0.655s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:11 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f Sep 04 06:08:11 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:12 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad69bba5-b7e2-4df5-8391-c3a48400495f" returned: 0 in 0.452s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-ad69bba5-b7e2-4df5-8391-c3a48400495f" released by "delete_volume" :: held 1.236s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Created reservations ['50b5c33f-f828-433e-9f5b-bd5c4a2b2338', 'c146bb8d-88e2-4424-825d-a66fd01c79a5', 'a3a60ba0-9458-4420-83cd-fb0053ddfb46', '26ff9d58-8c42-47ee-82bc-ed60d7b45770'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:12 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:12 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Flow 'volume_create_manager' (65a204a5-62c7-4405-9307-95a292129e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6bc292-b73e-4981-aa62-0ad6b08accf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6bc292-b73e-4981-aa62-0ad6b08accf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-936386377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d155c9e5-4fcb-49cf-a617-887bb89e1c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6ad305d41e4d25a6de2eddf86f83bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:12Z,use_quota=True,user_id='3444915cb90f4b35a8c16b95790c920e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc46307-cd47-4381-acce-95f18bf7b881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc46307-cd47-4381-acce-95f18bf7b881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4b8ff8-dd6e-4a47-b7b2-e06fdd63adc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4b8ff8-dd6e-4a47-b7b2-e06fdd63adc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd155c9e5-4fcb-49cf-a617-887bb89e1c42', 'volume_name': 'volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939f9524-44d3-4edb-a4ae-b3eea44c7db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939f9524-44d3-4edb-a4ae-b3eea44c7db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b2be3d-6e21-45b9-868f-c5bbd3c1e27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume d155c9e5-4fcb-49cf-a617-887bb89e1c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42', 'volume_size': 1} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-936386377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d155c9e5-4fcb-49cf-a617-887bb89e1c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6ad305d41e4d25a6de2eddf86f83bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:12Z,use_quota=True,user_id='3444915cb90f4b35a8c16b95790c920e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Creating volume d155c9e5-4fcb-49cf-a617-887bb89e1c42 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:08:12 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:12 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 1073741824 Sep 04 06:08:12 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:12 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.294s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Deleted volume successfully. Sep 04 06:08:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d01f38d4-2324-4bcc-86a1-66d00b74e559 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-ad69bba5-b7e2-4df5-8391-c3a48400495f-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:13 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 1073741824" returned: 0 in 0.591s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:13 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 Sep 04 06:08:13 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:13 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b2be3d-6e21-45b9-868f-c5bbd3c1e27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1b881e-7481-403c-8535-ec06aa65173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 (d155c9e5-4fcb-49cf-a617-887bb89e1c42): created successfully Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1b881e-7481-403c-8535-ec06aa65173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Flow 'volume_create_manager' (65a204a5-62c7-4405-9307-95a292129e3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-798fbff2-da4f-45c4-93ba-2001d98c06b8 tempest-CreateVolumesFromSnapshotTest-55100628 None] Created volume successfully. Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Flow 'volume_create_manager' (7a103f21-5fd1-45f9-a9aa-a138e6af98c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d62b1a7-499c-4b8c-9fcd-54799c235fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d62b1a7-499c-4b8c-9fcd-54799c235fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-431009058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c99c1f1-e842-44a2-a3a1-a2b61778cff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b14960707e40e2831b58abc1a6c188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:14Z,use_quota=True,user_id='cc532e56ad194d77ac2654d6ce35fb8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90eea42d-0287-443e-b491-fdaae9ff8a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90eea42d-0287-443e-b491-fdaae9ff8a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be388c7e-59aa-40d3-9d2d-7babf55dc097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be388c7e-59aa-40d3-9d2d-7babf55dc097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c99c1f1-e842-44a2-a3a1-a2b61778cff6', 'volume_name': 'volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f09e06c-ef64-4e7c-8044-3e261358480a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f09e06c-ef64-4e7c-8044-3e261358480a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186b66ec-3c76-4c48-bba3-58d6adc9af3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Volume 2c99c1f1-e842-44a2-a3a1-a2b61778cff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6', 'volume_size': 1} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-431009058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c99c1f1-e842-44a2-a3a1-a2b61778cff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b14960707e40e2831b58abc1a6c188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:14Z,use_quota=True,user_id='cc532e56ad194d77ac2654d6ce35fb8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Creating volume 2c99c1f1-e842-44a2-a3a1-a2b61778cff6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:08:13 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:08:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:14 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 1073741824 Sep 04 06:08:14 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:14 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 1073741824" returned: 0 in 0.533s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:14 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 Sep 04 06:08:14 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:14 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6" returned: 0 in 0.367s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:08:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.052s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186b66ec-3c76-4c48-bba3-58d6adc9af3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8047df9-3f2e-4bea-809e-7eada199f946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] Creating offline snapshot 436303d4-f9e7-492c-a472-04b1629ee72a of volume d155c9e5-4fcb-49cf-a617-887bb89e1c42 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:08:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Volume volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 (2c99c1f1-e842-44a2-a3a1-a2b61778cff6): created successfully Sep 04 06:08:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8047df9-3f2e-4bea-809e-7eada199f946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Flow 'volume_create_manager' (7a103f21-5fd1-45f9-a9aa-a138e6af98c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e54e24f-9303-4f89-9ea8-2e70785fbeed]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c5f9f271-a119-48db-bcea-eb9738f6ead5 tempest-VolumesSnapshotTestJSON-26079179 None] Created volume successfully. Sep 04 06:08:15 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 Sep 04 06:08:15 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:15 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:15 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a 1G Sep 04 06:08:15 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:15 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a 1G" returned: 0 in 0.509s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:15 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a Sep 04 06:08:16 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:16 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a" returned: 0 in 0.390s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:16 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a is being set with open permissions: ugo+rw Sep 04 06:08:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:16 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a Sep 04 06:08:16 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:16 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:16 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.info Sep 04 06:08:16 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:17 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.info" returned: 0 in 0.284s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:17 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.info is being set with open permissions: ugo+rw Sep 04 06:08:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:17 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.info Sep 04 06:08:17 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:17 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.info" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.849s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] Creating offline snapshot df2f6248-5e09-4948-960d-c9ed4b0d82b5 of volume 2c99c1f1-e842-44a2-a3a1-a2b61778cff6 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:08:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eeb611f6-8a54-47f4-9aa3-bda014ee014c tempest-CreateVolumesFromSnapshotTest-55100628 None] Create snapshot completed successfully Sep 04 06:08:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3faf716-f7e7-4986-943f-1c2e9e7407fa]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:17 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 Sep 04 06:08:17 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:17 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:17 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 1G Sep 04 06:08:17 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:18 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 1G" returned: 0 in 0.660s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:18 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 Sep 04 06:08:18 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Flow 'volume_create_manager' (dcdf4f24-4f61-464b-bb41-399a3113498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4116eed5-1263-400e-9f66-8e0bda494057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4116eed5-1263-400e-9f66-8e0bda494057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-344100435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d274e1-0617-4dfe-b3ce-e35f08f8989a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6ad305d41e4d25a6de2eddf86f83bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:19Z,use_quota=True,user_id='3444915cb90f4b35a8c16b95790c920e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdf3c4e-edb1-4622-84dc-6b90fe1ed2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdf3c4e-edb1-4622-84dc-6b90fe1ed2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc13561-e787-40f2-aefd-46067766aba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc13561-e787-40f2-aefd-46067766aba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d274e1-0617-4dfe-b3ce-e35f08f8989a', 'volume_name': 'volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83243a76-7693-42ec-bc23-b3bcdbd0bb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83243a76-7693-42ec-bc23-b3bcdbd0bb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337e33ce-7a2d-484b-9bac-deb3cca1202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume 25d274e1-0617-4dfe-b3ce-e35f08f8989a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a', 'volume_size': 1} Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:18 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5" returned: 0 in 0.446s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:18 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 is being set with open permissions: ugo+rw Sep 04 06:08:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:19 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 Sep 04 06:08:19 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:19 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5" returned: 0 in 0.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Flow 'volume_create_manager' (bdecb2f8-74fe-4d04-8415-c5b327894ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90708e31-2913-40f4-802a-5a1bce77ccf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90708e31-2913-40f4-802a-5a1bce77ccf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-204773578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ff40c3-61b8-4707-912e-902e1f12602c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6ad305d41e4d25a6de2eddf86f83bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:19Z,use_quota=True,user_id='3444915cb90f4b35a8c16b95790c920e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:19 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.info Sep 04 06:08:19 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c941658-a999-406a-809e-152076a9742c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c941658-a999-406a-809e-152076a9742c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dfafdf-fc48-4e1d-9b93-93ad05697c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dfafdf-fc48-4e1d-9b93-93ad05697c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ff40c3-61b8-4707-912e-902e1f12602c', 'volume_name': 'volume-21ff40c3-61b8-4707-912e-902e1f12602c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d5ef56-63c0-4251-9de2-9566127f43ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d5ef56-63c0-4251-9de2-9566127f43ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b0c436-6dd7-4693-bd78-170653925e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume 21ff40c3-61b8-4707-912e-902e1f12602c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ff40c3-61b8-4707-912e-902e1f12602c', 'volume_size': 1} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:19 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.info" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:19 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.info is being set with open permissions: ugo+rw Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:19 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.info Sep 04 06:08:19 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Flow 'volume_create_manager' (d9617ada-de45-40af-a421-760568d24277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c7775c-a685-4beb-893b-d4dacca3ea07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c7775c-a685-4beb-893b-d4dacca3ea07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1351941618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdfd33d7-8375-4e47-ad5a-8d504bce24ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6ad305d41e4d25a6de2eddf86f83bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:20Z,use_quota=True,user_id='3444915cb90f4b35a8c16b95790c920e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1261e7d0-cb6e-45af-b37e-fb75fba8c24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1261e7d0-cb6e-45af-b37e-fb75fba8c24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6e6d45-2ea4-4415-9b4d-5227c1f563e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6e6d45-2ea4-4415-9b4d-5227c1f563e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdfd33d7-8375-4e47-ad5a-8d504bce24ff', 'volume_name': 'volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2770f5-ba23-4e9f-bed0-cf1a12b4fa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2770f5-ba23-4e9f-bed0-cf1a12b4fa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9706fb-ca24-4152-8230-6ab62d523ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume fdfd33d7-8375-4e47-ad5a-8d504bce24ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff', 'volume_size': 1} Sep 04 06:08:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:20 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.info" returned: 0 in 0.376s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.765s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.281s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-344100435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d274e1-0617-4dfe-b3ce-e35f08f8989a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6ad305d41e4d25a6de2eddf86f83bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:19Z,use_quota=True,user_id='3444915cb90f4b35a8c16b95790c920e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Creating volume 25d274e1-0617-4dfe-b3ce-e35f08f8989a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:08:20 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:20 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a 1073741824 Sep 04 06:08:20 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3c37e1c3-64a2-46ad-985d-debe1cd093d1 tempest-VolumesSnapshotTestJSON-26079179 None] Create snapshot completed successfully Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Flow 'volume_create_manager' (26ea589e-0521-4cd4-86a8-454103962e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc954355-e0a0-4416-98ee-b0936d25395e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc954355-e0a0-4416-98ee-b0936d25395e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2073971301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b430fd0-18a0-40ba-aa99-4106908d86db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6ad305d41e4d25a6de2eddf86f83bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:20Z,use_quota=True,user_id='3444915cb90f4b35a8c16b95790c920e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6506a7-ff19-455a-baac-d6b3c9331bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6506a7-ff19-455a-baac-d6b3c9331bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd45601-ea51-4393-8589-0f6e573db459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd45601-ea51-4393-8589-0f6e573db459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b430fd0-18a0-40ba-aa99-4106908d86db', 'volume_name': 'volume-8b430fd0-18a0-40ba-aa99-4106908d86db', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6da8ebc-d51a-4d31-b96d-fe9cc06448b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6da8ebc-d51a-4d31-b96d-fe9cc06448b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2ca77f-d5b5-4c89-af67-4be1a9ecefb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume 8b430fd0-18a0-40ba-aa99-4106908d86db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b430fd0-18a0-40ba-aa99-4106908d86db', 'volume_size': 1} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Flow 'volume_create_manager' (a0074dad-a988-4c6c-bfce-70e9d0d604aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3afb8f0-a111-49a8-a45b-591e37fb75e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3afb8f0-a111-49a8-a45b-591e37fb75e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-320158904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb9eb92-78af-441b-979f-08808cb06ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6ad305d41e4d25a6de2eddf86f83bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:21Z,use_quota=True,user_id='3444915cb90f4b35a8c16b95790c920e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64874faa-6e3a-4f6f-975c-eb9bbbc34fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64874faa-6e3a-4f6f-975c-eb9bbbc34fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c9b054-62ec-4458-ab50-f20c006ebcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c9b054-62ec-4458-ab50-f20c006ebcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb9eb92-78af-441b-979f-08808cb06ae2', 'volume_name': 'volume-afb9eb92-78af-441b-979f-08808cb06ae2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36448258-8580-4f3c-b45c-89df467ce620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36448258-8580-4f3c-b45c-89df467ce620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5555a3e1-7e3b-4052-9899-26a000517435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume afb9eb92-78af-441b-979f-08808cb06ae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb9eb92-78af-441b-979f-08808cb06ae2', 'volume_size': 1} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:20 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a 1073741824" returned: 0 in 0.577s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:20 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a Sep 04 06:08:20 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:21 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.548s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-204773578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ff40c3-61b8-4707-912e-902e1f12602c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6ad305d41e4d25a6de2eddf86f83bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:19Z,use_quota=True,user_id='3444915cb90f4b35a8c16b95790c920e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Creating volume 21ff40c3-61b8-4707-912e-902e1f12602c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:08:21 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-21ff40c3-61b8-4707-912e-902e1f12602c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337e33ce-7a2d-484b-9bac-deb3cca1202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7924f177-868c-4d9d-97d5-901674e50432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:21 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-21ff40c3-61b8-4707-912e-902e1f12602c 1073741824 Sep 04 06:08:21 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a (25d274e1-0617-4dfe-b3ce-e35f08f8989a): created successfully Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7924f177-868c-4d9d-97d5-901674e50432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Flow 'volume_create_manager' (dcdf4f24-4f61-464b-bb41-399a3113498f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3e1f4047-fcaa-4277-be77-ae24478c81e9 tempest-CreateVolumesFromSnapshotTest-55100628 None] Created volume successfully. Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Flow 'volume_create_manager' (b3c3c31b-c913-4655-b628-1d3c76ea704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3edb066-10f9-4f0e-8623-bc5e4d984446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3edb066-10f9-4f0e-8623-bc5e4d984446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2039688150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a53c1d-f014-42e6-bf5e-be23660f84d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b14960707e40e2831b58abc1a6c188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=df2f6248-5e09-4948-960d-c9ed4b0d82b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:21Z,use_quota=True,user_id='cc532e56ad194d77ac2654d6ce35fb8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01728abc-7e79-4b76-a4de-8526455a9695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01728abc-7e79-4b76-a4de-8526455a9695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac7a21d-76a9-4daa-98e6-1f37916e4cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac7a21d-76a9-4daa-98e6-1f37916e4cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84a53c1d-f014-42e6-bf5e-be23660f84d8', 'volume_name': 'volume-84a53c1d-f014-42e6-bf5e-be23660f84d8', 'volume_size': 1, 'snapshot_id': 'df2f6248-5e09-4948-960d-c9ed4b0d82b5'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2be2443-17cb-4691-88bd-4c0ae9863dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2be2443-17cb-4691-88bd-4c0ae9863dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e13930-5648-4262-88de-113eed0e7ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Volume 84a53c1d-f014-42e6-bf5e-be23660f84d8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84a53c1d-f014-42e6-bf5e-be23660f84d8', 'volume_size': 1, 'snapshot_id': 'df2f6248-5e09-4948-960d-c9ed4b0d82b5'} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:21 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-21ff40c3-61b8-4707-912e-902e1f12602c 1073741824" returned: 0 in 0.505s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-21ff40c3-61b8-4707-912e-902e1f12602c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:21 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-21ff40c3-61b8-4707-912e-902e1f12602c Sep 04 06:08:21 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:21 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-21ff40c3-61b8-4707-912e-902e1f12602c" returned: 0 in 0.232s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.905s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1351941618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdfd33d7-8375-4e47-ad5a-8d504bce24ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6ad305d41e4d25a6de2eddf86f83bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:20Z,use_quota=True,user_id='3444915cb90f4b35a8c16b95790c920e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Creating volume fdfd33d7-8375-4e47-ad5a-8d504bce24ff {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:08:21 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b0c436-6dd7-4693-bd78-170653925e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ff40c3-61b8-4707-912e-902e1f12602c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f857a1e1-46ac-4871-89b7-3a3547ecaf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:21 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff 1073741824 Sep 04 06:08:21 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume volume-21ff40c3-61b8-4707-912e-902e1f12602c (21ff40c3-61b8-4707-912e-902e1f12602c): created successfully Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f857a1e1-46ac-4871-89b7-3a3547ecaf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Flow 'volume_create_manager' (bdecb2f8-74fe-4d04-8415-c5b327894ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b898d9ba-840a-4c63-b0b7-a05977a89bc4 tempest-CreateVolumesFromSnapshotTest-55100628 None] Created volume successfully. Sep 04 06:08:22 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff 1073741824" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:22 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff Sep 04 06:08:22 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:22 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.141s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2073971301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b430fd0-18a0-40ba-aa99-4106908d86db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6ad305d41e4d25a6de2eddf86f83bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:20Z,use_quota=True,user_id='3444915cb90f4b35a8c16b95790c920e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Creating volume 8b430fd0-18a0-40ba-aa99-4106908d86db {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:08:22 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8b430fd0-18a0-40ba-aa99-4106908d86db 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:22 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8b430fd0-18a0-40ba-aa99-4106908d86db 1073741824 Sep 04 06:08:22 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9706fb-ca24-4152-8230-6ab62d523ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553a225e-a5da-4f99-86c1-74b01e0e33c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff (fdfd33d7-8375-4e47-ad5a-8d504bce24ff): created successfully Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553a225e-a5da-4f99-86c1-74b01e0e33c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Flow 'volume_create_manager' (d9617ada-de45-40af-a421-760568d24277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e0257bdc-38bb-4906-ac79-9f25d12f7e06 tempest-CreateVolumesFromSnapshotTest-55100628 None] Created volume successfully. Sep 04 06:08:22 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8b430fd0-18a0-40ba-aa99-4106908d86db 1073741824" returned: 0 in 0.414s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8b430fd0-18a0-40ba-aa99-4106908d86db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:22 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8b430fd0-18a0-40ba-aa99-4106908d86db Sep 04 06:08:22 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:23 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8b430fd0-18a0-40ba-aa99-4106908d86db" returned: 0 in 0.232s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.518s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-320158904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb9eb92-78af-441b-979f-08808cb06ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6ad305d41e4d25a6de2eddf86f83bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:21Z,use_quota=True,user_id='3444915cb90f4b35a8c16b95790c920e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Creating volume afb9eb92-78af-441b-979f-08808cb06ae2 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:08:23 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-afb9eb92-78af-441b-979f-08808cb06ae2 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:23 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-afb9eb92-78af-441b-979f-08808cb06ae2 1073741824 Sep 04 06:08:23 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2ca77f-d5b5-4c89-af67-4be1a9ecefb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b430fd0-18a0-40ba-aa99-4106908d86db', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2a3be6-8ad4-48cb-a0e9-7971d10f46d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume volume-8b430fd0-18a0-40ba-aa99-4106908d86db (8b430fd0-18a0-40ba-aa99-4106908d86db): created successfully Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2a3be6-8ad4-48cb-a0e9-7971d10f46d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Flow 'volume_create_manager' (26ea589e-0521-4cd4-86a8-454103962e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c9ca4df7-6f5c-4b8b-a485-3efc02524817 tempest-CreateVolumesFromSnapshotTest-55100628 None] Created volume successfully. Sep 04 06:08:23 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-afb9eb92-78af-441b-979f-08808cb06ae2 1073741824" returned: 0 in 0.420s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-afb9eb92-78af-441b-979f-08808cb06ae2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:23 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-afb9eb92-78af-441b-979f-08808cb06ae2 Sep 04 06:08:23 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:23 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-afb9eb92-78af-441b-979f-08808cb06ae2" returned: 0 in 0.248s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.445s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-df2f6248-5e09-4948-960d-c9ed4b0d82b5-84a53c1d-f014-42e6-bf5e-be23660f84d8" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5555a3e1-7e3b-4052-9899-26a000517435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb9eb92-78af-441b-979f-08808cb06ae2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73447d75-5304-438d-8fbe-be576fd703a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Volume volume-afb9eb92-78af-441b-979f-08808cb06ae2 (afb9eb92-78af-441b-979f-08808cb06ae2): created successfully Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73447d75-5304-438d-8fbe-be576fd703a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Flow 'volume_create_manager' (a0074dad-a988-4c6c-bfce-70e9d0d604aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-df2f6248-5e09-4948-960d-c9ed4b0d82b5-84a53c1d-f014-42e6-bf5e-be23660f84d8" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Creating volume 84a53c1d-f014-42e6-bf5e-be23660f84d8 from snapshot df2f6248-5e09-4948-960d-c9ed4b0d82b5 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:08:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-84a53c1d-f014-42e6-bf5e-be23660f84d8" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-84a53c1d-f014-42e6-bf5e-be23660f84d8" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] snapshot: df2f6248-5e09-4948-960d-c9ed4b0d82b5, volume: 84a53c1d-f014-42e6-bf5e-be23660f84d8, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 06:08:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dd2e91fc-7234-4759-9878-c8af05ccccd5 tempest-CreateVolumesFromSnapshotTest-55100628 None] Created volume successfully. Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdc4dd3-77d5-45ad-9812-c9cce0ad9107]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:24 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 Sep 04 06:08:24 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:24 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ce3e9c-20b5-4bcf-abda-2265cd219a64]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:24 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 Sep 04 06:08:24 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:24 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] will copy from snapshot at /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Path /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 06:08:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:24 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8 Sep 04 06:08:24 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-afb9eb92-78af-441b-979f-08808cb06ae2-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-afb9eb92-78af-441b-979f-08808cb06ae2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-quobyte-afb9eb92-78af-441b-979f-08808cb06ae2" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-afb9eb92-78af-441b-979f-08808cb06ae2" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad67a66e-5a3d-4575-a1d8-af94d718d4fe]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-afb9eb92-78af-441b-979f-08808cb06ae2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:25 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-afb9eb92-78af-441b-979f-08808cb06ae2 Sep 04 06:08:25 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:25 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:25 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:25 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-afb9eb92-78af-441b-979f-08808cb06ae2" returned: 0 in 0.751s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-afb9eb92-78af-441b-979f-08808cb06ae2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:26 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:26 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-afb9eb92-78af-441b-979f-08808cb06ae2 Sep 04 06:08:26 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.762s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:26 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:26 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:08:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:08:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:08:26 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-afb9eb92-78af-441b-979f-08808cb06ae2" returned: 0 in 0.677s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-afb9eb92-78af-441b-979f-08808cb06ae2" released by "delete_volume" :: held 1.500s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Created reservations ['aea96c76-b3c8-49f7-926c-41972f9799a2', '3ab624d8-7840-4283-aa35-33495eccaf03', 'f10df0c5-c297-4a1f-ad32-b17e77d8113d', 'aee95959-d6ab-4f2b-bba0-1f353bce0806'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:27 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:27 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-8b430fd0-18a0-40ba-aa99-4106908d86db-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-8b430fd0-18a0-40ba-aa99-4106908d86db-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-quobyte-8b430fd0-18a0-40ba-aa99-4106908d86db" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-8b430fd0-18a0-40ba-aa99-4106908d86db" acquired by "delete_volume" :: waited 0.048s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc31c539-a45b-4c19-b3fe-118542652b42]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8b430fd0-18a0-40ba-aa99-4106908d86db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:28 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.982s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:28 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Deleted volume successfully. Sep 04 06:08:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b4df0f9-69b3-45d6-a685-fbae2dc4f2b3 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-afb9eb92-78af-441b-979f-08808cb06ae2-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:28 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8b430fd0-18a0-40ba-aa99-4106908d86db Sep 04 06:08:28 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:28 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8b430fd0-18a0-40ba-aa99-4106908d86db" returned: 0 in 0.901s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8b430fd0-18a0-40ba-aa99-4106908d86db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:28 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8b430fd0-18a0-40ba-aa99-4106908d86db Sep 04 06:08:28 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:29 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8b430fd0-18a0-40ba-aa99-4106908d86db" returned: 0 in 0.735s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-8b430fd0-18a0-40ba-aa99-4106908d86db" released by "delete_volume" :: held 1.768s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Created reservations ['b9ee0021-339d-4b63-b1a7-c96dbc89390b', '9fb0ba33-ce42-444c-aaff-b196aa6b97a4', '52b3769f-2602-4856-91a4-4a3e518373fc', '13fbb76b-d1a0-40ec-9840-52bddd1e8456'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:29 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:29 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-fdfd33d7-8375-4e47-ad5a-8d504bce24ff-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:30 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.435s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Deleted volume successfully. Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-fdfd33d7-8375-4e47-ad5a-8d504bce24ff-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7ebaf019-1f60-4ce7-9302-43051ff4e688 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-8b430fd0-18a0-40ba-aa99-4106908d86db-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:30 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8" returned: 0 in 5.509s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:08:30 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Converted 1024.00 MB image at 185.81 MB/s Sep 04 06:08:30 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8 is being set with open permissions: ugo+rw Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:30 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8 Sep 04 06:08:30 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-quobyte-fdfd33d7-8375-4e47-ad5a-8d504bce24ff" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-fdfd33d7-8375-4e47-ad5a-8d504bce24ff" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c26212-9fec-42cb-af32-783a0142ed5d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:30 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff Sep 04 06:08:30 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:30 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8" returned: 0 in 0.281s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-84a53c1d-f014-42e6-bf5e-be23660f84d8" released by "_copy_volume_from_snapshot" :: held 6.628s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-df2f6248-5e09-4948-960d-c9ed4b0d82b5-84a53c1d-f014-42e6-bf5e-be23660f84d8" released by "_create_volume_from_snapshot" :: held 6.715s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.772s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e13930-5648-4262-88de-113eed0e7ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a53c1d-f014-42e6-bf5e-be23660f84d8', 'volume_size': 1, 'snapshot_id': 'df2f6248-5e09-4948-960d-c9ed4b0d82b5'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e592fee-76bf-4717-b15b-234092fdf0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Volume volume-84a53c1d-f014-42e6-bf5e-be23660f84d8 (84a53c1d-f014-42e6-bf5e-be23660f84d8): created successfully Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e592fee-76bf-4717-b15b-234092fdf0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Flow 'volume_create_manager' (b3c3c31b-c913-4655-b628-1d3c76ea704c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6faab08f-03bd-4561-b8e4-d4e39d598d90 tempest-VolumesSnapshotTestJSON-26079179 None] Created volume successfully. Sep 04 06:08:30 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff" returned: 0 in 0.417s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:30 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff Sep 04 06:08:30 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:31 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-fdfd33d7-8375-4e47-ad5a-8d504bce24ff" returned: 0 in 0.256s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-fdfd33d7-8375-4e47-ad5a-8d504bce24ff" released by "delete_volume" :: held 0.735s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Created reservations ['e9d1563e-bad0-428b-8f42-7403f1d56a1a', '52d43bf2-cf72-448e-b5d9-3caf3c13439e', 'b0a10f9f-4262-4bde-ac53-a33ecd46591b', '94ca40e7-e2af-4eb4-bab6-5f24a6a59647'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:31 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:31 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-21ff40c3-61b8-4707-912e-902e1f12602c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-21ff40c3-61b8-4707-912e-902e1f12602c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:31 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-quobyte-21ff40c3-61b8-4707-912e-902e1f12602c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Deleted volume successfully. Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-21ff40c3-61b8-4707-912e-902e1f12602c" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-84a53c1d-f014-42e6-bf5e-be23660f84d8-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5b097ca4-dce6-4167-81d0-c89ee66c9b3d tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-fdfd33d7-8375-4e47-ad5a-8d504bce24ff-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e91b79-abe3-401a-aa33-b805da927cd0]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-21ff40c3-61b8-4707-912e-902e1f12602c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-84a53c1d-f014-42e6-bf5e-be23660f84d8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-84a53c1d-f014-42e6-bf5e-be23660f84d8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-84a53c1d-f014-42e6-bf5e-be23660f84d8" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2356e29d-feb7-4246-a67f-b3f0e8416f13]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:31 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-21ff40c3-61b8-4707-912e-902e1f12602c Sep 04 06:08:31 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:31 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8 Sep 04 06:08:31 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:32 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-21ff40c3-61b8-4707-912e-902e1f12602c" returned: 0 in 0.388s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-21ff40c3-61b8-4707-912e-902e1f12602c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:32 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-21ff40c3-61b8-4707-912e-902e1f12602c Sep 04 06:08:32 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:32 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:32 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8 Sep 04 06:08:32 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:32 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-21ff40c3-61b8-4707-912e-902e1f12602c" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-21ff40c3-61b8-4707-912e-902e1f12602c" released by "delete_volume" :: held 0.700s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:32 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Created reservations ['d4e670eb-fc41-44b6-8de6-b4e801cecda2', 'ea108025-c7f3-4947-a51b-01a4e2b9c30f', '734138d3-9e08-428a-82de-330a4bba3b68', 'b7b78af7-9e48-4c3c-a4b4-3779c320c516'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-84a53c1d-f014-42e6-bf5e-be23660f84d8" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-84a53c1d-f014-42e6-bf5e-be23660f84d8" released by "delete_volume" :: held 0.657s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:32 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Created reservations ['e5266218-f1e8-4d64-8aa2-10068c8316f4', 'df5fe5fb-5f9b-48fb-b67b-b6817eadfadb', 'b2c857d6-3532-4d17-a212-99e8804b6e5c', '944094b5-0def-462e-991b-0dcffc284472'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:32 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:32 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:32 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-25d274e1-0617-4dfe-b3ce-e35f08f8989a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-25d274e1-0617-4dfe-b3ce-e35f08f8989a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:32 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.266s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Deleted volume successfully. Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-quobyte-25d274e1-0617-4dfe-b3ce-e35f08f8989a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-25d274e1-0617-4dfe-b3ce-e35f08f8989a" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-34c705b4-377e-4efc-952e-40a76f7d8ffd tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-21ff40c3-61b8-4707-912e-902e1f12602c-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[68551afd-4868-4733-b9a4-5f2ed2c354f5]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-df2f6248-5e09-4948-960d-c9ed4b0d82b5-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:32 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Deleted volume successfully. Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-df2f6248-5e09-4948-960d-c9ed4b0d82b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-2c99c1f1-e842-44a2-a3a1-a2b61778cff6" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a92688c-75d2-4701-80cd-88b79de0f440 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-84a53c1d-f014-42e6-bf5e-be23660f84d8-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-2c99c1f1-e842-44a2-a3a1-a2b61778cff6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-df2f6248-5e09-4948-960d-c9ed4b0d82b5" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-df2f6248-5e09-4948-960d-c9ed4b0d82b5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Deleting offline snapshot df2f6248-5e09-4948-960d-c9ed4b0d82b5 of volume 2c99c1f1-e842-44a2-a3a1-a2b61778cff6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] snapshot_file for this snap is: volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40b3ad1-3f41-41f8-b541-c91b8e03acf8]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:32 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a Sep 04 06:08:32 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:33 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 Sep 04 06:08:33 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:33 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:33 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a Sep 04 06:08:33 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:33 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f02926-bcf3-4606-ab8f-ed2663613828]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:33 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-25d274e1-0617-4dfe-b3ce-e35f08f8989a" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-25d274e1-0617-4dfe-b3ce-e35f08f8989a" released by "delete_volume" :: held 0.727s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:33 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 Sep 04 06:08:33 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Created reservations ['ab14006c-62ed-40ae-808c-aa4e324f2842', '5fbed9ce-de93-41a1-be76-259e59236c49', '8b4c730c-6b54-4bb8-8f28-5d172110bd14', '59c06385-5079-456a-867e-76d7f21970a5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:33 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:33 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-436303d4-f9e7-492c-a472-04b1629ee72a-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-436303d4-f9e7-492c-a472-04b1629ee72a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-quobyte-d155c9e5-4fcb-49cf-a617-887bb89e1c42" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-d155c9e5-4fcb-49cf-a617-887bb89e1c42" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-quobyte-436303d4-f9e7-492c-a472-04b1629ee72a" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-436303d4-f9e7-492c-a472-04b1629ee72a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Deleting offline snapshot 436303d4-f9e7-492c-a472-04b1629ee72a of volume d155c9e5-4fcb-49cf-a617-887bb89e1c42 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] snapshot_file for this snap is: volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f457c4b-e35b-46fd-a1d5-71e11b1d85ed]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:33 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.305s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:33 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Deleted volume successfully. Sep 04 06:08:34 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6" returned: 0 in 0.607s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7f3ce334-f7b3-492c-98ea-ef698225151e tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-25d274e1-0617-4dfe-b3ce-e35f08f8989a-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:34 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 Sep 04 06:08:34 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:34 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a Sep 04 06:08:34 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:34 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a" returned: 0 in 0.380s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:08:34 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3272291-3a3e-4cd6-89de-ca9802287994]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:34 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5 Sep 04 06:08:34 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:34 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 Sep 04 06:08:34 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:34 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6.df2f6248-5e09-4948-960d-c9ed4b0d82b5" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-df2f6248-5e09-4948-960d-c9ed4b0d82b5" released by "_delete_snapshot" :: held 1.739s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-2c99c1f1-e842-44a2-a3a1-a2b61778cff6" released by "delete_snapshot" :: held 1.761s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Created reservations ['1243201e-821d-4ea3-bc9e-e9679314f96c', '27b0ae08-1a00-4dad-b643-71808e7eb647', 'f1c63be0-dbab-4e67-9464-0324d9d594fd', 'fb718686-1a9a-4893-b105-6a38919f9dbb'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:34 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:34 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a Sep 04 06:08:34 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Delete snapshot completed successfully. Sep 04 06:08:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aca5e102-55dd-4710-afe0-af32082d7d10 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-df2f6248-5e09-4948-960d-c9ed4b0d82b5-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:35 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-2c99c1f1-e842-44a2-a3a1-a2b61778cff6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a" returned: 0 in 0.358s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-2c99c1f1-e842-44a2-a3a1-a2b61778cff6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:35 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a Sep 04 06:08:35 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-2c99c1f1-e842-44a2-a3a1-a2b61778cff6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-2c99c1f1-e842-44a2-a3a1-a2b61778cff6" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b971508-ef14-4c52-81e7-f38838583a6e]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:35 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 Sep 04 06:08:35 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:35 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42.436303d4-f9e7-492c-a472-04b1629ee72a" returned: 0 in 0.266s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-436303d4-f9e7-492c-a472-04b1629ee72a" released by "_delete_snapshot" :: held 1.481s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-d155c9e5-4fcb-49cf-a617-887bb89e1c42" released by "delete_snapshot" :: held 1.512s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Created reservations ['64affe50-84d8-42b8-be66-a19aa398e4d3', 'd59cadec-dcaf-4298-ad29-15bd0dc2004e', 'd16fc24b-0762-4d36-afe8-f8e178b21931', '588eec6f-aaae-452f-b933-34f0f9195534'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Delete snapshot completed successfully. Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6c58930f-86a7-4fcf-a568-b2b8937da6e1 tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-436303d4-f9e7-492c-a472-04b1629ee72a-delete_snapshot" released by "delete_snapshot" :: held 1.666s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:35 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:35 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6 Sep 04 06:08:35 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:35 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-2c99c1f1-e842-44a2-a3a1-a2b61778cff6" returned: 0 in 0.257s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-2c99c1f1-e842-44a2-a3a1-a2b61778cff6" released by "delete_volume" :: held 0.702s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Created reservations ['e19891d6-8a8d-4b5b-bfec-93155613bcb1', '00c6a6b8-18c0-4b5b-a949-31fa67ac28a6', '822df47c-8fd1-45e2-a5d9-bc92a19342f6', '3fec0a2d-b7c3-4ac0-b7af-9cbdfa566ff9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:36 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:36 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-d155c9e5-4fcb-49cf-a617-887bb89e1c42-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-d155c9e5-4fcb-49cf-a617-887bb89e1c42-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "cinder-quobyte-d155c9e5-4fcb-49cf-a617-887bb89e1c42" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-d155c9e5-4fcb-49cf-a617-887bb89e1c42" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[587aea7c-2b97-433f-87c6-382e51fceaa0]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:36 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.270s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Deleted volume successfully. Sep 04 06:08:36 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 Sep 04 06:08:36 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b48e8b97-7000-43b8-b2b1-42e799cc8ab4 tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-2c99c1f1-e842-44a2-a3a1-a2b61778cff6-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-7b472519-8eb6-4d40-b3b0-4c40aa197d40-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-7b472519-8eb6-4d40-b3b0-4c40aa197d40-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "cinder-quobyte-7b472519-8eb6-4d40-b3b0-4c40aa197d40" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-7b472519-8eb6-4d40-b3b0-4c40aa197d40" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7445098e-2617-44df-ada7-5346253662c0]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:36 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:36 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:36 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:36 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42 Sep 04 06:08:36 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:36 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d155c9e5-4fcb-49cf-a617-887bb89e1c42" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:36 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-quobyte-d155c9e5-4fcb-49cf-a617-887bb89e1c42" released by "delete_volume" :: held 0.750s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:36 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40 Sep 04 06:08:36 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Created reservations ['e8d0c905-c91e-40ac-9e8d-2b8a20d5bbb9', '2b72e332-0385-4518-b924-d1f77de111dc', '84872ad8-cd71-4f48-97cc-04986573672b', 'bc873849-c1a5-492e-94fa-6c08c27cbf88'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:37 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:37 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:37 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7b472519-8eb6-4d40-b3b0-4c40aa197d40" returned: 0 in 0.259s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-quobyte-7b472519-8eb6-4d40-b3b0-4c40aa197d40" released by "delete_volume" :: held 0.748s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Created reservations ['f147c095-f3a5-4db4-9c6e-1f57ff2c0810', '5049d1cc-b720-4706-bed8-9776b52850eb', '483f17c1-0ca2-45ac-b67f-a6b9c5999699', '339817e5-2264-44f3-9861-95c88231ed96'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:37 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.295s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Deleted volume successfully. Sep 04 06:08:37 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:37 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cdb3a5cb-55b6-43f5-afc5-ff170208132f tempest-CreateVolumesFromSnapshotTest-55100628 None] Lock "cinder-d155c9e5-4fcb-49cf-a617-887bb89e1c42-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:37 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.295s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Deleted volume successfully. Sep 04 06:08:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-130a681f-388e-4b2c-9440-7205bfc139ba tempest-VolumesSnapshotTestJSON-26079179 None] Lock "cinder-7b472519-8eb6-4d40-b3b0-4c40aa197d40-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:43 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=125,cinder:UPDATE=149,cinder:DELETE=16,cinder:INSERT=45 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:08:43 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=159,cinder:INSERT=42,cinder:SELECT=128,cinder:DELETE=10 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:08:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:08:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Flow 'volume_create_manager' (dee557bb-92fb-4f2d-a436-c8669cd1b024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc48472-a532-494f-961d-36300198dc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc48472-a532-494f-961d-36300198dc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5949c0f-6e59-4843-b929-48bf3a1c4d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf97481d9704b0abd5ea75128d5e813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:44Z,use_quota=True,user_id='b21dca1c94d3425288e721ad19b2871d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f6e241-becd-45d1-b3af-8842f26c3178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f6e241-becd-45d1-b3af-8842f26c3178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c09c57-4b1b-4ef9-b90c-67c9d32df039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:43 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 06:08:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c09c57-4b1b-4ef9-b90c-67c9d32df039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e5949c0f-6e59-4843-b929-48bf3a1c4d41', 'volume_name': 'volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41', 'volume_size': 1, 'image_id': 'da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e67e626003ed58465e0889c7c6422bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bbf97481d9704b0abd5ea75128d5e813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31cdfd6bf268fd83ef4c7705f1ce792e225505f8a9abe0ac205aa85f35c5fe50619bb1345d3b9319ac28b8b6e586b4b5eb825c2c6c3c227b61c5f2c933da85c9', 'id': 'da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'created_at': datetime.datetime(2026, 9, 4, 4, 8, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da6ff6cc-c966-4ddc-944c-d037b7435c2b/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2cd227-e0d2-4539-9492-60edfcc063d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2cd227-e0d2-4539-9492-60edfcc063d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4361fd2c-d188-4fb9-b36a-7967dbf077a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Volume e5949c0f-6e59-4843-b929-48bf3a1c4d41: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41', 'volume_size': 1, 'image_id': 'da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e67e626003ed58465e0889c7c6422bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bbf97481d9704b0abd5ea75128d5e813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31cdfd6bf268fd83ef4c7705f1ce792e225505f8a9abe0ac205aa85f35c5fe50619bb1345d3b9319ac28b8b6e586b4b5eb825c2c6c3c227b61c5f2c933da85c9', 'id': 'da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'created_at': datetime.datetime(2026, 9, 4, 4, 8, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da6ff6cc-c966-4ddc-944c-d037b7435c2b/file', 'properties': {}}, 'image_service': } Sep 04 06:08:44 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Trying to clone e5949c0f-6e59-4843-b929-48bf3a1c4d41 from image da6ff6cc-c966-4ddc-944c-d037b7435c2b at location (None, [{'url': 'file:///opt/stack/data/glance/images/da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 06:08:44 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 06:08:44 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Image download 0.00 MB at 0.00 MB/s Sep 04 06:08:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[96868fb2-a75c-4993-aef2-b4be453c12ec]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:44 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD Sep 04 06:08:44 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:44 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:44 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD Sep 04 06:08:44 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:45 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Temporary image da6ff6cc-c966-4ddc-944c-d037b7435c2b is fetched for user b21dca1c94d3425288e721ad19b2871d. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e49a754-2ce1-4e66-aaf5-ac8383b28d5e]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:45 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD Sep 04 06:08:45 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:45 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:45 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD Sep 04 06:08:45 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:45 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD" returned: 1 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5949c0f-6e59-4843-b929-48bf3a1c4d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf97481d9704b0abd5ea75128d5e813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:44Z,use_quota=True,user_id='b21dca1c94d3425288e721ad19b2871d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Creating volume e5949c0f-6e59-4843-b929-48bf3a1c4d41 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:08:45 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:08:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:45 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 1073741824 Sep 04 06:08:45 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:46 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 1073741824" returned: 0 in 0.473s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:46 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 Sep 04 06:08:46 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:46 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:08:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:46 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Attempting download of da6ff6cc-c966-4ddc-944c-d037b7435c2b ((None, [{'url': 'file:///opt/stack/data/glance/images/da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'metadata': {}}])) to volume e5949c0f-6e59-4843-b929-48bf3a1c4d41. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 06:08:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1ad17a-4e77-4c1e-bb6e-4840b08f511a]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da6ff6cc-c966-4ddc-944c-d037b7435c2b_s2sbpxhz {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:46 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da6ff6cc-c966-4ddc-944c-d037b7435c2b_s2sbpxhz Sep 04 06:08:46 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:47 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da6ff6cc-c966-4ddc-944c-d037b7435c2b_s2sbpxhz" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da6ff6cc-c966-4ddc-944c-d037b7435c2b_s2sbpxhz {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:47 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da6ff6cc-c966-4ddc-944c-d037b7435c2b_s2sbpxhz Sep 04 06:08:47 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:47 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da6ff6cc-c966-4ddc-944c-d037b7435c2b_s2sbpxhz" returned: 1 in 0.375s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da6ff6cc-c966-4ddc-944c-d037b7435c2b_s2sbpxhz' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:08:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e08b2ef-80a8-4322-99ff-f2bbf8f16db4]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:47 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD Sep 04 06:08:47 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:47 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:48 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD Sep 04 06:08:48 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:48 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:08:48 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] da6ff6cc-c966-4ddc-944c-d037b7435c2b was raw, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 06:08:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:48 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 Sep 04 06:08:48 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:48 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41" returned: 0 in 0.527s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:48 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_da6ff6cc-c966-4ddc-944c-d037b7435c2b_15xqw9s2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:08:48 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 06:08:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:48 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 1G Sep 04 06:08:48 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:49 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 1G" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:49 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Downloaded image da6ff6cc-c966-4ddc-944c-d037b7435c2b ((None, [{'url': 'file:///opt/stack/data/glance/images/da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'metadata': {}}])) to volume e5949c0f-6e59-4843-b929-48bf3a1c4d41 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 06:08:49 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Temporary image da6ff6cc-c966-4ddc-944c-d037b7435c2b for user b21dca1c94d3425288e721ad19b2871d is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 06:08:49 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Marking volume e5949c0f-6e59-4843-b929-48bf3a1c4d41 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 06:08:49 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Copying metadata from image da6ff6cc-c966-4ddc-944c-d037b7435c2b to e5949c0f-6e59-4843-b929-48bf3a1c4d41. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 06:08:49 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Creating volume glance metadata for volume e5949c0f-6e59-4843-b929-48bf3a1c4d41 backed by image da6ff6cc-c966-4ddc-944c-d037b7435c2b with: {'image_id': 'da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5e67e626003ed58465e0889c7c6422bd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 06:08:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4361fd2c-d188-4fb9-b36a-7967dbf077a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41', 'volume_size': 1, 'image_id': 'da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e67e626003ed58465e0889c7c6422bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bbf97481d9704b0abd5ea75128d5e813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31cdfd6bf268fd83ef4c7705f1ce792e225505f8a9abe0ac205aa85f35c5fe50619bb1345d3b9319ac28b8b6e586b4b5eb825c2c6c3c227b61c5f2c933da85c9', 'id': 'da6ff6cc-c966-4ddc-944c-d037b7435c2b', 'created_at': datetime.datetime(2026, 9, 4, 4, 8, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da6ff6cc-c966-4ddc-944c-d037b7435c2b/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c5faf6-d473-4d3f-a5d0-387ad82afecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:08:49 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Volume volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 (e5949c0f-6e59-4843-b929-48bf3a1c4d41): created successfully Sep 04 06:08:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c5faf6-d473-4d3f-a5d0-387ad82afecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:08:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Flow 'volume_create_manager' (dee557bb-92fb-4f2d-a436-c8669cd1b024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:08:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6cd58d0e-0e0e-4fd3-b9bb-015a07a1e814 tempest-VolumeImageDependencyTests-1641556726 None] Created volume successfully. Sep 04 06:08:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Acquiring lock "cinder-e5949c0f-6e59-4843-b929-48bf3a1c4d41-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Lock "cinder-e5949c0f-6e59-4843-b929-48bf3a1c4d41-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Acquiring lock "cinder-quobyte-e5949c0f-6e59-4843-b929-48bf3a1c4d41" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:08:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Lock "cinder-quobyte-e5949c0f-6e59-4843-b929-48bf3a1c4d41" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:08:50 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dbf607-54dc-439c-ba62-cdc052aa6fd7]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:08:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:50 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 Sep 04 06:08:50 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:50 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41" returned: 0 in 0.416s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:50 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41 Sep 04 06:08:50 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:51 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e5949c0f-6e59-4843-b929-48bf3a1c4d41" returned: 0 in 0.290s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Lock "cinder-quobyte-e5949c0f-6e59-4843-b929-48bf3a1c4d41" released by "delete_volume" :: held 0.757s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:51 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Created reservations ['79c6a24f-28eb-47f9-a359-60e1f67f2808', 'df47798d-c21c-472b-bec3-26cb2656fb0f', 'e52c8149-4a0f-412c-93e3-a191b18651de', 'feac8131-1c5c-4fbd-a547-8c3e5706ed88'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:08:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:08:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:08:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:08:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:08:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:08:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:08:51 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:08:51 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:08:51 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Sep 04 06:08:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.330s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:08:51 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:08:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Deleted volume successfully. Sep 04 06:08:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b5e6833-1739-4052-a065-f2aa6307482e tempest-VolumeImageDependencyTests-1641556726 None] Lock "cinder-e5949c0f-6e59-4843-b929-48bf3a1c4d41-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:08:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-78fe6f09-b148-4f29-a732-5cbb7779c3e4 req-b1a89676-dd03-41ad-acd7-db881ebb9fbb tempest-TestShelveInstance-15420912 None] Terminate volume connection completed successfully. Sep 04 06:08:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-78fe6f09-b148-4f29-a732-5cbb7779c3e4 req-b1a89676-dd03-41ad-acd7-db881ebb9fbb tempest-TestShelveInstance-15420912 None] Deleting attachment ee85dec3-8980-4b9b-8b0c-fe6aa1e4b4b8. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:09:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-7bc86315-a67f-482c-b3b5-5cba80270c32 req-483a2ba6-199e-43ac-9c84-dfd28fceb63c tempest-TestShelveInstance-15420912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:09:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-7bc86315-a67f-482c-b3b5-5cba80270c32 req-483a2ba6-199e-43ac-9c84-dfd28fceb63c tempest-TestShelveInstance-15420912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:09:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-7bc86315-a67f-482c-b3b5-5cba80270c32 req-483a2ba6-199e-43ac-9c84-dfd28fceb63c tempest-TestShelveInstance-15420912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:09:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-7bc86315-a67f-482c-b3b5-5cba80270c32 req-483a2ba6-199e-43ac-9c84-dfd28fceb63c tempest-TestShelveInstance-15420912 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0e3a85f-da19-4378-84e1-90a1f57e3ab1', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:09:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-7bc86315-a67f-482c-b3b5-5cba80270c32 req-483a2ba6-199e-43ac-9c84-dfd28fceb63c tempest-TestShelveInstance-15420912 None] attachment_update completed successfully. Sep 04 06:09:12 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=21,cinder:INSERT=4,cinder:UPDATE=11 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:09:12 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=18,cinder:INSERT=10,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Flow 'volume_create_manager' (d2e3f718-ae39-4108-8bb0-0e51ea237b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bef131-1b68-4d5a-9bda-b4f21eea3eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bef131-1b68-4d5a-9bda-b4f21eea3eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-534017294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed7e443-e90f-4604-bda9-043e4b60d341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9515246cde7b4f72a0ba5201308c399f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:14Z,use_quota=True,user_id='9fc54b54f8924c98a420ecf4dc80b193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc34dc16-104b-4e07-a887-a62935a87a1c),volume_type_id=dc34dc16-104b-4e07-a887-a62935a87a1c)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef97274-7561-4e4e-b5f8-85ea812922f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef97274-7561-4e4e-b5f8-85ea812922f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607a01db-85d0-46f5-8109-d18e22d8e076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607a01db-85d0-46f5-8109-d18e22d8e076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed7e443-e90f-4604-bda9-043e4b60d341', 'volume_name': 'volume-3ed7e443-e90f-4604-bda9-043e4b60d341', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbe37a1-8a85-4065-bc6c-0621f25d0959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbe37a1-8a85-4065-bc6c-0621f25d0959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32b75f3-3584-4030-82ff-1b858ff92058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Volume 3ed7e443-e90f-4604-bda9-043e4b60d341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed7e443-e90f-4604-bda9-043e4b60d341', 'volume_size': 1} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-534017294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed7e443-e90f-4604-bda9-043e4b60d341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9515246cde7b4f72a0ba5201308c399f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:14Z,use_quota=True,user_id='9fc54b54f8924c98a420ecf4dc80b193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc34dc16-104b-4e07-a887-a62935a87a1c),volume_type_id=dc34dc16-104b-4e07-a887-a62935a87a1c)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Creating volume 3ed7e443-e90f-4604-bda9-043e4b60d341 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:09:14 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ed7e443-e90f-4604-bda9-043e4b60d341 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:14 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ed7e443-e90f-4604-bda9-043e4b60d341 1073741824 Sep 04 06:09:14 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:14 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Flow 'volume_create_manager' (5ae10ab7-d397-42d2-b25b-fc516abd0039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c1a9ed-2c6a-4f9e-8205-b41ca6a8dc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c1a9ed-2c6a-4f9e-8205-b41ca6a8dc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-858293351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e26af6c-8791-4ce9-bfbc-e717faba0660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9515246cde7b4f72a0ba5201308c399f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:15Z,use_quota=True,user_id='9fc54b54f8924c98a420ecf4dc80b193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e7d919-0640-4793-8a02-a6527b512d40),volume_type_id=d7e7d919-0640-4793-8a02-a6527b512d40)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8aef2a4-2fed-492e-b678-865e1a766e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8aef2a4-2fed-492e-b678-865e1a766e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28ac448-08fd-4b76-9914-975ccf76f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28ac448-08fd-4b76-9914-975ccf76f81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e26af6c-8791-4ce9-bfbc-e717faba0660', 'volume_name': 'volume-1e26af6c-8791-4ce9-bfbc-e717faba0660', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7001b5e-b940-45cf-b758-c97a5514cbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7001b5e-b940-45cf-b758-c97a5514cbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a18eed-456c-4509-b91b-26410dffa649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Volume 1e26af6c-8791-4ce9-bfbc-e717faba0660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e26af6c-8791-4ce9-bfbc-e717faba0660', 'volume_size': 1} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:09:15 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ed7e443-e90f-4604-bda9-043e4b60d341 1073741824" returned: 0 in 0.583s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ed7e443-e90f-4604-bda9-043e4b60d341 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:15 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ed7e443-e90f-4604-bda9-043e4b60d341 Sep 04 06:09:15 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:15 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ed7e443-e90f-4604-bda9-043e4b60d341" returned: 0 in 0.318s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-858293351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e26af6c-8791-4ce9-bfbc-e717faba0660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9515246cde7b4f72a0ba5201308c399f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:15Z,use_quota=True,user_id='9fc54b54f8924c98a420ecf4dc80b193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e7d919-0640-4793-8a02-a6527b512d40),volume_type_id=d7e7d919-0640-4793-8a02-a6527b512d40)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Creating volume 1e26af6c-8791-4ce9-bfbc-e717faba0660 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:09:15 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1e26af6c-8791-4ce9-bfbc-e717faba0660 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:15 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1e26af6c-8791-4ce9-bfbc-e717faba0660 1073741824 Sep 04 06:09:15 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32b75f3-3584-4030-82ff-1b858ff92058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed7e443-e90f-4604-bda9-043e4b60d341', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cfc2cb-8344-46cb-b0dd-9bcd708d0861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Flow 'volume_create_manager' (1f0963c9-05d9-4c71-bf2b-aafb58b65933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec30791a-0016-4b88-96a7-33893ed4772c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Volume volume-3ed7e443-e90f-4604-bda9-043e4b60d341 (3ed7e443-e90f-4604-bda9-043e4b60d341): created successfully Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cfc2cb-8344-46cb-b0dd-9bcd708d0861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Flow 'volume_create_manager' (d2e3f718-ae39-4108-8bb0-0e51ea237b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec30791a-0016-4b88-96a7-33893ed4772c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1531100624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386eb756-fd73-4646-a844-f90418f2ff26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9515246cde7b4f72a0ba5201308c399f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:16Z,use_quota=True,user_id='9fc54b54f8924c98a420ecf4dc80b193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e069993-58c1-49ea-b315-9b0e5568c8e7),volume_type_id=7e069993-58c1-49ea-b315-9b0e5568c8e7)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4919f527-2807-4149-80a4-9c12fb5d993a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4919f527-2807-4149-80a4-9c12fb5d993a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a0e1f6-f6fa-4f86-8a04-b3c03337f4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:15 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 06:09:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9d34cd92-dfc2-4dba-9950-bb8f786d3a35 tempest-TestInstancesWithCinderVolumes-1105586364 None] Created volume successfully. Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a0e1f6-f6fa-4f86-8a04-b3c03337f4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '386eb756-fd73-4646-a844-f90418f2ff26', 'volume_name': 'volume-386eb756-fd73-4646-a844-f90418f2ff26', 'volume_size': 1, 'image_id': 'de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--325667046', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9515246cde7b4f72a0ba5201308c399f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'created_at': datetime.datetime(2026, 9, 4, 4, 9, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 9, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de99d3a3-87ac-4d82-a26b-9017e988a6e7/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44d43d3-5181-4fa6-8a95-51f3f7b63808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44d43d3-5181-4fa6-8a95-51f3f7b63808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8addeb-e292-4287-bc25-22a165b791e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Volume 386eb756-fd73-4646-a844-f90418f2ff26: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-386eb756-fd73-4646-a844-f90418f2ff26', 'volume_size': 1, 'image_id': 'de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--325667046', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9515246cde7b4f72a0ba5201308c399f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'created_at': datetime.datetime(2026, 9, 4, 4, 9, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 9, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de99d3a3-87ac-4d82-a26b-9017e988a6e7/file', 'properties': {}}, 'image_service': } Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Trying to clone 386eb756-fd73-4646-a844-f90418f2ff26 from image de99d3a3-87ac-4d82-a26b-9017e988a6e7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 06:09:16 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1e26af6c-8791-4ce9-bfbc-e717faba0660 1073741824" returned: 0 in 0.519s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1e26af6c-8791-4ce9-bfbc-e717faba0660 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:16 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1e26af6c-8791-4ce9-bfbc-e717faba0660 Sep 04 06:09:16 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:16 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1e26af6c-8791-4ce9-bfbc-e717faba0660" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a18eed-456c-4509-b91b-26410dffa649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e26af6c-8791-4ce9-bfbc-e717faba0660', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d803d30-42ff-4b3c-ab6f-688c6465000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Volume volume-1e26af6c-8791-4ce9-bfbc-e717faba0660 (1e26af6c-8791-4ce9-bfbc-e717faba0660): created successfully Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d803d30-42ff-4b3c-ab6f-688c6465000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Flow 'volume_create_manager' (5ae10ab7-d397-42d2-b25b-fc516abd0039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:09:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1fd24944-d6e5-400b-afa0-1c1a903b7c44 tempest-TestInstancesWithCinderVolumes-1105586364 None] Created volume successfully. Sep 04 06:09:19 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD, size 20.69 MB, duration 3.20 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 06:09:19 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Image download 20.69 MB at 6.46 MB/s Sep 04 06:09:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[36caf12d-b534-44e1-9e48-bc393c4d4a3b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:09:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:19 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD Sep 04 06:09:19 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:19 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:19 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Temporary image de99d3a3-87ac-4d82-a26b-9017e988a6e7 is fetched for user 9fc54b54f8924c98a420ecf4dc80b193. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 06:09:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfb8186-6acd-4f46-9630-0b24c0765814]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:09:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:19 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD Sep 04 06:09:19 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:20 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1531100624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386eb756-fd73-4646-a844-f90418f2ff26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9515246cde7b4f72a0ba5201308c399f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:16Z,use_quota=True,user_id='9fc54b54f8924c98a420ecf4dc80b193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e069993-58c1-49ea-b315-9b0e5568c8e7),volume_type_id=7e069993-58c1-49ea-b315-9b0e5568c8e7)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Creating volume 386eb756-fd73-4646-a844-f90418f2ff26 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:09:20 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:20 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 1073741824 Sep 04 06:09:20 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:20 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 1073741824" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:20 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 Sep 04 06:09:20 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:20 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Attempting download of de99d3a3-87ac-4d82-a26b-9017e988a6e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'metadata': {}}])) to volume 386eb756-fd73-4646-a844-f90418f2ff26. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb302208-f782-47b0-91ff-dc40bfb4761c]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:09:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de99d3a3-87ac-4d82-a26b-9017e988a6e7_xxf0nrcq {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:20 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de99d3a3-87ac-4d82-a26b-9017e988a6e7_xxf0nrcq Sep 04 06:09:20 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:21 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de99d3a3-87ac-4d82-a26b-9017e988a6e7_xxf0nrcq" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de99d3a3-87ac-4d82-a26b-9017e988a6e7_xxf0nrcq {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:21 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de99d3a3-87ac-4d82-a26b-9017e988a6e7_xxf0nrcq Sep 04 06:09:21 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:21 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de99d3a3-87ac-4d82-a26b-9017e988a6e7_xxf0nrcq" returned: 1 in 0.310s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de99d3a3-87ac-4d82-a26b-9017e988a6e7_xxf0nrcq' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:09:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f3482b-0aba-4779-ab32-592bb68ee72c]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:09:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:21 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD Sep 04 06:09:21 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:21 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:21 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] de99d3a3-87ac-4d82-a26b-9017e988a6e7 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 06:09:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:21 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 Sep 04 06:09:21 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:23 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26" returned: 0 in 1.616s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de99d3a3-87ac-4d82-a26b-9017e988a6e7_89n7qly1devstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:09:23 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Converted 112.00 MB image at 69.27 MB/s Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:23 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 1G Sep 04 06:09:23 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:23 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 1G" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Downloaded image de99d3a3-87ac-4d82-a26b-9017e988a6e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'metadata': {}}])) to volume 386eb756-fd73-4646-a844-f90418f2ff26 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Temporary image de99d3a3-87ac-4d82-a26b-9017e988a6e7 for user 9fc54b54f8924c98a420ecf4dc80b193 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Marking volume 386eb756-fd73-4646-a844-f90418f2ff26 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Copying metadata from image de99d3a3-87ac-4d82-a26b-9017e988a6e7 to 386eb756-fd73-4646-a844-f90418f2ff26. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Creating volume glance metadata for volume 386eb756-fd73-4646-a844-f90418f2ff26 backed by image de99d3a3-87ac-4d82-a26b-9017e988a6e7 with: {'image_id': 'de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'image_name': 'tempest-scenario-img--325667046', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8addeb-e292-4287-bc25-22a165b791e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386eb756-fd73-4646-a844-f90418f2ff26', 'volume_size': 1, 'image_id': 'de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--325667046', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9515246cde7b4f72a0ba5201308c399f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de99d3a3-87ac-4d82-a26b-9017e988a6e7', 'created_at': datetime.datetime(2026, 9, 4, 4, 9, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 9, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de99d3a3-87ac-4d82-a26b-9017e988a6e7/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278d3b72-a823-40c2-a9fb-6e3258d5c847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:09:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Volume volume-386eb756-fd73-4646-a844-f90418f2ff26 (386eb756-fd73-4646-a844-f90418f2ff26): created successfully Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278d3b72-a823-40c2-a9fb-6e3258d5c847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:09:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Flow 'volume_create_manager' (1f0963c9-05d9-4c71-bf2b-aafb58b65933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:09:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c64a4b83-2fb8-49e6-ab22-66690a7ce106 tempest-TestInstancesWithCinderVolumes-1105586364 None] Created volume successfully. Sep 04 06:09:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:09:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:09:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:09:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:09:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:09:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:09:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:25 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:09:25 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:25 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.257s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:09:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:09:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:09:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:09:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-41076a88-fa87-4188-a9ca-20467b91c53c req-e9d22359-d3fe-4c03-9783-d5c55da3dc6f tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:09:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-41076a88-fa87-4188-a9ca-20467b91c53c req-e9d22359-d3fe-4c03-9783-d5c55da3dc6f tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:09:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-41076a88-fa87-4188-a9ca-20467b91c53c req-e9d22359-d3fe-4c03-9783-d5c55da3dc6f tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:09:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-41076a88-fa87-4188-a9ca-20467b91c53c req-e9d22359-d3fe-4c03-9783-d5c55da3dc6f tempest-TestInstancesWithCinderVolumes-1105586364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-386eb756-fd73-4646-a844-f90418f2ff26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9015233-a0a5-4888-8604-193a13925153', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:09:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-41076a88-fa87-4188-a9ca-20467b91c53c req-e9d22359-d3fe-4c03-9783-d5c55da3dc6f tempest-TestInstancesWithCinderVolumes-1105586364 None] attachment_update completed successfully. Sep 04 06:09:36 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:09:36 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=25,cinder:UPDATE=9,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:09:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-4f80b5c4-2d8b-4bcf-8df5-9b5a827f73ef tempest-TestShelveInstance-15420912 None] Terminate volume connection completed successfully. Sep 04 06:09:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-4f80b5c4-2d8b-4bcf-8df5-9b5a827f73ef tempest-TestShelveInstance-15420912 None] Deleting attachment b0e3a85f-da19-4378-84e1-90a1f57e3ab1. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:09:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Acquiring lock "cinder-73d2f718-82fe-404e-82b8-ccc9a7f751e9-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:09:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Lock "cinder-73d2f718-82fe-404e-82b8-ccc9a7f751e9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:09:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Acquiring lock "cinder-quobyte-73d2f718-82fe-404e-82b8-ccc9a7f751e9" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:09:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Lock "cinder-quobyte-73d2f718-82fe-404e-82b8-ccc9a7f751e9" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:09:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bc85f5-c81e-4114-a669-9d0443408c4d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:09:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:49 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 Sep 04 06:09:49 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:49 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9" returned: 0 in 0.422s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:49 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9 Sep 04 06:09:49 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:49 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-73d2f718-82fe-404e-82b8-ccc9a7f751e9" returned: 0 in 0.279s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Lock "cinder-quobyte-73d2f718-82fe-404e-82b8-ccc9a7f751e9" released by "delete_volume" :: held 0.745s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:09:49 devstack cinder-volume[87132]: DEBUG cinder.quota [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Created reservations ['900babeb-a1be-4e64-85ee-e572ee99f357', '605e8b47-7afe-4e8b-8d9d-6520aaf0145d', '7b5502df-1341-4848-81e7-473996d2fd0d', '99bfca1b-f754-4f8a-893a-40a2a9b68f83'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:09:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:09:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:09:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:09:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:09:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:09:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:09:50 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:09:50 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:09:50 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Sep 04 06:09:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:09:50 devstack cinder-volume[87132]: DEBUG cinder.manager [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:09:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Deleted volume successfully. Sep 04 06:09:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-484f306d-0ea5-4053-8fc6-a1548eebfb27 req-fc9273a7-abb8-4978-a55a-7ac4462690a0 tempest-TestShelveInstance-15420912 None] Lock "cinder-73d2f718-82fe-404e-82b8-ccc9a7f751e9-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:09:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f92376f1-1913-44d8-92f4-604677d43b7d req-84b45caf-3e8d-4bb6-94ab-286517eb749c tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:09:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f92376f1-1913-44d8-92f4-604677d43b7d req-84b45caf-3e8d-4bb6-94ab-286517eb749c tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:09:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f92376f1-1913-44d8-92f4-604677d43b7d req-84b45caf-3e8d-4bb6-94ab-286517eb749c tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:09:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-f92376f1-1913-44d8-92f4-604677d43b7d req-84b45caf-3e8d-4bb6-94ab-286517eb749c tempest-TestInstancesWithCinderVolumes-1105586364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-3ed7e443-e90f-4604-bda9-043e4b60d341', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '295c0ca7-54e3-4ea6-9621-f6e26e61fbc5', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:09:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-f92376f1-1913-44d8-92f4-604677d43b7d req-84b45caf-3e8d-4bb6-94ab-286517eb749c tempest-TestInstancesWithCinderVolumes-1105586364 None] attachment_update completed successfully. Sep 04 06:10:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-a329f97f-fa3b-4a7e-b15c-0f105756b83b req-9aa9dbf8-793f-444f-a024-bd8014166916 tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-a329f97f-fa3b-4a7e-b15c-0f105756b83b req-9aa9dbf8-793f-444f-a024-bd8014166916 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-a329f97f-fa3b-4a7e-b15c-0f105756b83b req-9aa9dbf8-793f-444f-a024-bd8014166916 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-a329f97f-fa3b-4a7e-b15c-0f105756b83b req-9aa9dbf8-793f-444f-a024-bd8014166916 tempest-TestInstancesWithCinderVolumes-1105586364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-1e26af6c-8791-4ce9-bfbc-e717faba0660', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cc83825-ce64-413b-b39f-c5f3ca7fedb4', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:10:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-a329f97f-fa3b-4a7e-b15c-0f105756b83b req-9aa9dbf8-793f-444f-a024-bd8014166916 tempest-TestInstancesWithCinderVolumes-1105586364 None] attachment_update completed successfully. Sep 04 06:10:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-9ad802ba-ea17-4bf1-ba2f-d2266ad21a8b req-3277980a-7433-46c3-b72e-a7042598bd7d tempest-TestInstancesWithCinderVolumes-1105586364 None] Terminate volume connection completed successfully. Sep 04 06:10:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-9ad802ba-ea17-4bf1-ba2f-d2266ad21a8b req-3277980a-7433-46c3-b72e-a7042598bd7d tempest-TestInstancesWithCinderVolumes-1105586364 None] Deleting attachment 295c0ca7-54e3-4ea6-9621-f6e26e61fbc5. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:10:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "cinder-3ed7e443-e90f-4604-bda9-043e4b60d341-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "cinder-3ed7e443-e90f-4604-bda9-043e4b60d341-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "cinder-quobyte-3ed7e443-e90f-4604-bda9-043e4b60d341" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "cinder-quobyte-3ed7e443-e90f-4604-bda9-043e4b60d341" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fedc86-3fa9-40c8-b410-4f2ca85ff8d5]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ed7e443-e90f-4604-bda9-043e4b60d341 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:06 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ed7e443-e90f-4604-bda9-043e4b60d341 Sep 04 06:10:06 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:06 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ed7e443-e90f-4604-bda9-043e4b60d341" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ed7e443-e90f-4604-bda9-043e4b60d341 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:06 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ed7e443-e90f-4604-bda9-043e4b60d341 Sep 04 06:10:06 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:07 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3ed7e443-e90f-4604-bda9-043e4b60d341" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "cinder-quobyte-3ed7e443-e90f-4604-bda9-043e4b60d341" released by "delete_volume" :: held 0.748s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:07 devstack cinder-volume[87132]: WARNING cinder.quota [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1971045934-922236691 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1971045934-922236691, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:10:07 devstack cinder-volume[87132]: WARNING cinder.quota [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1971045934-922236691 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1971045934-922236691, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Created reservations ['3bf4c76e-b96a-4196-9304-fd148af01981', 'd1382b62-90a1-4cd7-aa76-fcbb150fe4ae', '79f0c0bf-bab9-4ece-825c-ad381d367ca2', 'f2e32633-25cb-455d-b262-75eec6650486'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Flow 'volume_create_manager' (cb4d9cef-b817-4289-841b-05b25c67f76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbaddb2-8e9b-4177-86f0-bbd5d831c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbaddb2-8e9b-4177-86f0-bbd5d831c940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a6cc47-d08d-495a-a647-fb7617038e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0493cdd414b4d1d9b9ed08426db8cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:07Z,use_quota=True,user_id='5b7a92be91be4fcd91dac8b70f048c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0688c30-44b8-4506-a73b-49b055c473d0),volume_type_id=a0688c30-44b8-4506-a73b-49b055c473d0)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2ec3dc-23cd-4740-acb9-fe7b54f425c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2ec3dc-23cd-4740-acb9-fe7b54f425c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5094d311-17ec-4089-9ce3-3fdb36c36358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:07 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:07 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5094d311-17ec-4089-9ce3-3fdb36c36358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6a6cc47-d08d-495a-a647-fb7617038e2e', 'volume_name': 'volume-f6a6cc47-d08d-495a-a647-fb7617038e2e', 'volume_size': 1, 'image_id': 'ef78f7f2-a5ea-47f8-8940-81b137555158', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef78f7f2-a5ea-47f8-8940-81b137555158', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e2c9b6032f74c8ef99b086e10049b6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0493cdd414b4d1d9b9ed08426db8cc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd1444c8c722cbdc82296b7bc798bcb1df0f5c28f971453c67a40b1a4f49ece23660561fa7ef4a6752a736c2a42e452f75d1ba3a8313c0cdc4cccc2e07d71a3ec', 'id': 'ef78f7f2-a5ea-47f8-8940-81b137555158', 'created_at': datetime.datetime(2026, 9, 4, 4, 10, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 10, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef78f7f2-a5ea-47f8-8940-81b137555158/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ec660c-dc68-4dd7-8b63-420426e2adb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ec660c-dc68-4dd7-8b63-420426e2adb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca00a6bb-4c81-4aac-bacf-d4de072e8a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Volume f6a6cc47-d08d-495a-a647-fb7617038e2e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6a6cc47-d08d-495a-a647-fb7617038e2e', 'volume_size': 1, 'image_id': 'ef78f7f2-a5ea-47f8-8940-81b137555158', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef78f7f2-a5ea-47f8-8940-81b137555158', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e2c9b6032f74c8ef99b086e10049b6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0493cdd414b4d1d9b9ed08426db8cc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd1444c8c722cbdc82296b7bc798bcb1df0f5c28f971453c67a40b1a4f49ece23660561fa7ef4a6752a736c2a42e452f75d1ba3a8313c0cdc4cccc2e07d71a3ec', 'id': 'ef78f7f2-a5ea-47f8-8940-81b137555158', 'created_at': datetime.datetime(2026, 9, 4, 4, 10, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 10, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef78f7f2-a5ea-47f8-8940-81b137555158/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Trying to clone f6a6cc47-d08d-495a-a647-fb7617038e2e from image ef78f7f2-a5ea-47f8-8940-81b137555158 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ef78f7f2-a5ea-47f8-8940-81b137555158', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 06:10:07 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.264s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Deleted volume successfully. Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c6e0d120-8ef7-45bb-a37d-0c704cafb581 tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "cinder-3ed7e443-e90f-4604-bda9-043e4b60d341-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 06:10:07 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Image download 0.00 MB at 0.00 MB/s Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[35110644-d6a4-4f9b-a8c0-2adad8c3810a]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:07 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD Sep 04 06:10:07 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:08 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:08 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD Sep 04 06:10:08 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:08 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:10:08 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Temporary image ef78f7f2-a5ea-47f8-8940-81b137555158 is fetched for user 5b7a92be91be4fcd91dac8b70f048c94. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 06:10:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4406f7-cf1a-49ea-bada-aeeacad43689]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:08 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD Sep 04 06:10:08 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:08 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:08 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD Sep 04 06:10:08 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:09 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a6cc47-d08d-495a-a647-fb7617038e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0493cdd414b4d1d9b9ed08426db8cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:07Z,use_quota=True,user_id='5b7a92be91be4fcd91dac8b70f048c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0688c30-44b8-4506-a73b-49b055c473d0),volume_type_id=a0688c30-44b8-4506-a73b-49b055c473d0)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Creating volume f6a6cc47-d08d-495a-a647-fb7617038e2e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:10:09 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:09 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e 1073741824 Sep 04 06:10:09 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:09 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e 1073741824" returned: 0 in 0.416s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:09 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e Sep 04 06:10:09 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:09 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e" returned: 0 in 0.264s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Attempting download of ef78f7f2-a5ea-47f8-8940-81b137555158 ((None, [{'url': 'file:///opt/stack/data/glance/images/ef78f7f2-a5ea-47f8-8940-81b137555158', 'metadata': {}}])) to volume f6a6cc47-d08d-495a-a647-fb7617038e2e. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3dab91-d83b-4ea3-ac31-9ae8f02bdacf]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef78f7f2-a5ea-47f8-8940-81b137555158_mg0ro6dm {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:10 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef78f7f2-a5ea-47f8-8940-81b137555158_mg0ro6dm Sep 04 06:10:10 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-cef2f884-2d7c-4ebd-9d1d-7cb720e67d63 req-cbc1c32e-865e-43e1-8d3e-8fd5b15ba345 tempest-TestInstancesWithCinderVolumes-1105586364 None] Terminate volume connection completed successfully. Sep 04 06:10:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-cef2f884-2d7c-4ebd-9d1d-7cb720e67d63 req-cbc1c32e-865e-43e1-8d3e-8fd5b15ba345 tempest-TestInstancesWithCinderVolumes-1105586364 None] Deleting attachment 6cc83825-ce64-413b-b39f-c5f3ca7fedb4. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:10:10 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef78f7f2-a5ea-47f8-8940-81b137555158_mg0ro6dm" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef78f7f2-a5ea-47f8-8940-81b137555158_mg0ro6dm {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:10 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef78f7f2-a5ea-47f8-8940-81b137555158_mg0ro6dm Sep 04 06:10:10 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:10 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef78f7f2-a5ea-47f8-8940-81b137555158_mg0ro6dm" returned: 1 in 0.318s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef78f7f2-a5ea-47f8-8940-81b137555158_mg0ro6dm' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:10:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[054fea04-29ce-4fc8-b532-4a6223c49ee6]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:10 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD Sep 04 06:10:10 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:10 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "cinder-1e26af6c-8791-4ce9-bfbc-e717faba0660-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "cinder-1e26af6c-8791-4ce9-bfbc-e717faba0660-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "cinder-quobyte-1e26af6c-8791-4ce9-bfbc-e717faba0660" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "cinder-quobyte-1e26af6c-8791-4ce9-bfbc-e717faba0660" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:11 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD Sep 04 06:10:11 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f2aab1-d01f-4665-ac31-617ea8dab54f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1e26af6c-8791-4ce9-bfbc-e717faba0660 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:11 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1e26af6c-8791-4ce9-bfbc-e717faba0660 Sep 04 06:10:11 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:11 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] ef78f7f2-a5ea-47f8-8940-81b137555158 was raw, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:11 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e Sep 04 06:10:11 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:11 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1e26af6c-8791-4ce9-bfbc-e717faba0660" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1e26af6c-8791-4ce9-bfbc-e717faba0660 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:11 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1e26af6c-8791-4ce9-bfbc-e717faba0660 Sep 04 06:10:11 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:11 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1e26af6c-8791-4ce9-bfbc-e717faba0660" returned: 0 in 0.252s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "cinder-quobyte-1e26af6c-8791-4ce9-bfbc-e717faba0660" released by "delete_volume" :: held 0.702s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:11 devstack cinder-volume[87132]: WARNING cinder.quota [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-395177851-2133712081 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-395177851-2133712081, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:10:11 devstack cinder-volume[87132]: WARNING cinder.quota [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-395177851-2133712081 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-395177851-2133712081, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:10:11 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Created reservations ['39043496-b601-4e28-bf1b-c2a718be8f49', '78c64de9-b055-4818-88d3-8bb1e7963143', 'c74de29a-781a-4ca5-8546-6b28e9ef8ec1', '768549ee-cdb9-4f55-adce-9dec0803ea44'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e" returned: 0 in 0.471s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ef78f7f2-a5ea-47f8-8940-81b137555158_rzu9x4zodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:10:11 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:11 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e 1G Sep 04 06:10:11 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:11 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:11 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:12 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e 1G" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Downloaded image ef78f7f2-a5ea-47f8-8940-81b137555158 ((None, [{'url': 'file:///opt/stack/data/glance/images/ef78f7f2-a5ea-47f8-8940-81b137555158', 'metadata': {}}])) to volume f6a6cc47-d08d-495a-a647-fb7617038e2e successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Temporary image ef78f7f2-a5ea-47f8-8940-81b137555158 for user 5b7a92be91be4fcd91dac8b70f048c94 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Marking volume f6a6cc47-d08d-495a-a647-fb7617038e2e as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Copying metadata from image ef78f7f2-a5ea-47f8-8940-81b137555158 to f6a6cc47-d08d-495a-a647-fb7617038e2e. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Creating volume glance metadata for volume f6a6cc47-d08d-495a-a647-fb7617038e2e backed by image ef78f7f2-a5ea-47f8-8940-81b137555158 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ef78f7f2-a5ea-47f8-8940-81b137555158', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7e2c9b6032f74c8ef99b086e10049b6d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 06:10:12 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.286s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Deleted volume successfully. Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e535a34b-aeae-47f0-9e70-196d46ec0a5c tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "cinder-1e26af6c-8791-4ce9-bfbc-e717faba0660-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca00a6bb-4c81-4aac-bacf-d4de072e8a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a6cc47-d08d-495a-a647-fb7617038e2e', 'volume_size': 1, 'image_id': 'ef78f7f2-a5ea-47f8-8940-81b137555158', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef78f7f2-a5ea-47f8-8940-81b137555158', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e2c9b6032f74c8ef99b086e10049b6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0493cdd414b4d1d9b9ed08426db8cc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd1444c8c722cbdc82296b7bc798bcb1df0f5c28f971453c67a40b1a4f49ece23660561fa7ef4a6752a736c2a42e452f75d1ba3a8313c0cdc4cccc2e07d71a3ec', 'id': 'ef78f7f2-a5ea-47f8-8940-81b137555158', 'created_at': datetime.datetime(2026, 9, 4, 4, 10, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 10, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef78f7f2-a5ea-47f8-8940-81b137555158/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788011f1-48dc-4b79-912e-a22d351ae016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Volume volume-f6a6cc47-d08d-495a-a647-fb7617038e2e (f6a6cc47-d08d-495a-a647-fb7617038e2e): created successfully Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788011f1-48dc-4b79-912e-a22d351ae016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Flow 'volume_create_manager' (cb4d9cef-b817-4289-841b-05b25c67f76f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5bce70d5-9195-471a-acb9-75aa344077e4 tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Created volume successfully. Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Acquiring lock "cinder-f6a6cc47-d08d-495a-a647-fb7617038e2e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Lock "cinder-f6a6cc47-d08d-495a-a647-fb7617038e2e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Acquiring lock "cinder-quobyte-f6a6cc47-d08d-495a-a647-fb7617038e2e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Lock "cinder-quobyte-f6a6cc47-d08d-495a-a647-fb7617038e2e" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eabdf16-d2a8-45c4-ae47-09d2f3c861a5]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:12 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e Sep 04 06:10:12 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:13 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:13 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e Sep 04 06:10:13 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:13 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f6a6cc47-d08d-495a-a647-fb7617038e2e" returned: 0 in 0.274s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Lock "cinder-quobyte-f6a6cc47-d08d-495a-a647-fb7617038e2e" released by "delete_volume" :: held 0.760s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:13 devstack cinder-volume[87132]: WARNING cinder.quota [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:10:13 devstack cinder-volume[87132]: WARNING cinder.quota [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Created reservations ['d78cd5a7-0adb-4792-a6c5-3f5134dd7c92', 'd8c7d998-1225-49ee-9ce7-097a6c852289', 'cc842caa-6c5a-4d2b-9fe2-11158b98f5a2', '4d4d5acc-4b8e-40de-bad9-55de5cfc84cc'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:13 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:13 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:13 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Deleted volume successfully. Sep 04 06:10:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-be40e7b1-5439-4602-9783-4730c452879f tempest-VolumeAndVolumeTypeFromImageTest-435871467 None] Lock "cinder-f6a6cc47-d08d-495a-a647-fb7617038e2e-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-46fd9046-888e-4702-988b-20c25d742375 req-d1b7f21d-7d95-4bf7-8cd9-b28d415311d7 tempest-TestInstancesWithCinderVolumes-1105586364 None] Terminate volume connection completed successfully. Sep 04 06:10:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-46fd9046-888e-4702-988b-20c25d742375 req-d1b7f21d-7d95-4bf7-8cd9-b28d415311d7 tempest-TestInstancesWithCinderVolumes-1105586364 None] Deleting attachment c9015233-a0a5-4888-8604-193a13925153. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:10:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "cinder-386eb756-fd73-4646-a844-f90418f2ff26-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "cinder-386eb756-fd73-4646-a844-f90418f2ff26-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "cinder-quobyte-386eb756-fd73-4646-a844-f90418f2ff26" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "cinder-quobyte-386eb756-fd73-4646-a844-f90418f2ff26" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cfeef5-13e3-4d7d-b28a-3606713b2f3b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:16 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 Sep 04 06:10:16 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:17 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:17 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26 Sep 04 06:10:17 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:17 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-386eb756-fd73-4646-a844-f90418f2ff26" returned: 0 in 0.260s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "cinder-quobyte-386eb756-fd73-4646-a844-f90418f2ff26" released by "delete_volume" :: held 0.744s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:17 devstack cinder-volume[87132]: WARNING cinder.quota [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-301192483-1096743856 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-301192483-1096743856, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:10:17 devstack cinder-volume[87132]: WARNING cinder.quota [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-301192483-1096743856 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-301192483-1096743856, it is now deprecated. Please use the default quota class for default quota. Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Created reservations ['d3c19e1f-334b-4d74-acfd-4dc8271419f2', '2a865588-42b4-48e7-9354-350d62653356', '49f61b5e-27b9-4ae4-9cd1-4655e6732fe3', 'e3bae387-b6a7-4c93-bd87-c1f516de9c0e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:17 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:17 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:17 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.252s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Deleted volume successfully. Sep 04 06:10:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3a885686-4b89-489b-a5db-acca509ee7db tempest-TestInstancesWithCinderVolumes-1105586364 None] Lock "cinder-386eb756-fd73-4646-a844-f90418f2ff26-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Flow 'volume_create_manager' (b4f33ad8-28aa-4522-b540-7b5edda43df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bde0af-8c0f-458d-ac76-a101cebdb38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bde0af-8c0f-458d-ac76-a101cebdb38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1664591970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e56137-56dd-49f2-af4b-c6f724f0c076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75840e86b0e543808200a2b9cdd0b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:19Z,use_quota=True,user_id='d527544acdcc480d99f78b13e0bd790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e254f82-fb50-461c-856a-984799cba3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e254f82-fb50-461c-856a-984799cba3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c657e545-5bac-402c-921c-5701dcb529d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c657e545-5bac-402c-921c-5701dcb529d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e56137-56dd-49f2-af4b-c6f724f0c076', 'volume_name': 'volume-30e56137-56dd-49f2-af4b-c6f724f0c076', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949a7207-6785-4390-9380-230b540275b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949a7207-6785-4390-9380-230b540275b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36d5f5c-815d-4099-8b3e-642890195e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume 30e56137-56dd-49f2-af4b-c6f724f0c076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e56137-56dd-49f2-af4b-c6f724f0c076', 'volume_size': 1} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1664591970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e56137-56dd-49f2-af4b-c6f724f0c076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75840e86b0e543808200a2b9cdd0b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:19Z,use_quota=True,user_id='d527544acdcc480d99f78b13e0bd790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Creating volume 30e56137-56dd-49f2-af4b-c6f724f0c076 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:10:18 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:10:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-30e56137-56dd-49f2-af4b-c6f724f0c076 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:18 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-30e56137-56dd-49f2-af4b-c6f724f0c076 1073741824 Sep 04 06:10:18 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:19 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-30e56137-56dd-49f2-af4b-c6f724f0c076 1073741824" returned: 0 in 0.459s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-30e56137-56dd-49f2-af4b-c6f724f0c076 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:19 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-30e56137-56dd-49f2-af4b-c6f724f0c076 Sep 04 06:10:19 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:19 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-30e56137-56dd-49f2-af4b-c6f724f0c076" returned: 0 in 0.248s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:10:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36d5f5c-815d-4099-8b3e-642890195e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e56137-56dd-49f2-af4b-c6f724f0c076', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d718f2e-d197-4ff6-9781-739146784076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume volume-30e56137-56dd-49f2-af4b-c6f724f0c076 (30e56137-56dd-49f2-af4b-c6f724f0c076): created successfully Sep 04 06:10:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d718f2e-d197-4ff6-9781-739146784076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Flow 'volume_create_manager' (b4f33ad8-28aa-4522-b540-7b5edda43df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b5a41dce-3c09-4e63-b153-cfb9ccf75483 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Created volume successfully. Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Flow 'volume_create_manager' (bd26d87f-dca1-4192-ac18-209a48b3dba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df26c99d-2ac3-40fc-8025-d12b4fb5829c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df26c99d-2ac3-40fc-8025-d12b4fb5829c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-276162994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71f29d4-589b-473d-91fb-f9a2437f200d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75840e86b0e543808200a2b9cdd0b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:20Z,use_quota=True,user_id='d527544acdcc480d99f78b13e0bd790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fe00a5-6ed2-42cb-bbb9-e7f3a6918e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fe00a5-6ed2-42cb-bbb9-e7f3a6918e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c7352a-c7e9-4259-8c22-d170b6433c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c7352a-c7e9-4259-8c22-d170b6433c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b71f29d4-589b-473d-91fb-f9a2437f200d', 'volume_name': 'volume-b71f29d4-589b-473d-91fb-f9a2437f200d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc665e24-5bdb-4cae-8ba1-a2746463b1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc665e24-5bdb-4cae-8ba1-a2746463b1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560ce007-4064-4831-bcd3-6da1ad0dfb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume b71f29d4-589b-473d-91fb-f9a2437f200d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b71f29d4-589b-473d-91fb-f9a2437f200d', 'volume_size': 1} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-276162994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71f29d4-589b-473d-91fb-f9a2437f200d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75840e86b0e543808200a2b9cdd0b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:20Z,use_quota=True,user_id='d527544acdcc480d99f78b13e0bd790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Creating volume b71f29d4-589b-473d-91fb-f9a2437f200d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:10:20 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b71f29d4-589b-473d-91fb-f9a2437f200d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:20 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b71f29d4-589b-473d-91fb-f9a2437f200d 1073741824 Sep 04 06:10:20 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Flow 'volume_create_manager' (5fec50c9-793c-48d6-8cf1-1cb0927b691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2148e9ab-5176-4a81-9a1c-5e53021f02f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2148e9ab-5176-4a81-9a1c-5e53021f02f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1803545780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d88d10-2d46-4ea1-91c5-c46eab4c869e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75840e86b0e543808200a2b9cdd0b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:21Z,use_quota=True,user_id='d527544acdcc480d99f78b13e0bd790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdb686d-eebf-499d-b4ac-97e670b72f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdb686d-eebf-499d-b4ac-97e670b72f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e076d59-6d8f-4669-82b4-86166607ba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e076d59-6d8f-4669-82b4-86166607ba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19d88d10-2d46-4ea1-91c5-c46eab4c869e', 'volume_name': 'volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344079af-a51a-4ada-8f54-b8240133e75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344079af-a51a-4ada-8f54-b8240133e75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0108619b-fe03-4c71-9079-1f8344ba3c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume 19d88d10-2d46-4ea1-91c5-c46eab4c869e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e', 'volume_size': 1} Sep 04 06:10:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:21 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b71f29d4-589b-473d-91fb-f9a2437f200d 1073741824" returned: 0 in 0.590s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b71f29d4-589b-473d-91fb-f9a2437f200d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:10:21 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b71f29d4-589b-473d-91fb-f9a2437f200d Sep 04 06:10:21 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Flow 'volume_create_manager' (a595c442-c146-434d-8252-47b4ff0a669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca1f2aa-0e56-4011-8c8d-61be2b3f5d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca1f2aa-0e56-4011-8c8d-61be2b3f5d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1732069208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b87b3c1-6881-418d-8c3b-2f7e98c39787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75840e86b0e543808200a2b9cdd0b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:21Z,use_quota=True,user_id='d527544acdcc480d99f78b13e0bd790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e29686f-3480-46dc-ab98-94ba1156a59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e29686f-3480-46dc-ab98-94ba1156a59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77037456-3e85-4b94-bab9-9ab069594732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77037456-3e85-4b94-bab9-9ab069594732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b87b3c1-6881-418d-8c3b-2f7e98c39787', 'volume_name': 'volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca41ba8a-2a4c-44a7-9a5f-8409b4890282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca41ba8a-2a4c-44a7-9a5f-8409b4890282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7fbcea2-03c7-4c66-8014-71c48ced71f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume 0b87b3c1-6881-418d-8c3b-2f7e98c39787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787', 'volume_size': 1} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:21 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b71f29d4-589b-473d-91fb-f9a2437f200d" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.542s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1803545780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d88d10-2d46-4ea1-91c5-c46eab4c869e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75840e86b0e543808200a2b9cdd0b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:21Z,use_quota=True,user_id='d527544acdcc480d99f78b13e0bd790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Creating volume 19d88d10-2d46-4ea1-91c5-c46eab4c869e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:10:21 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560ce007-4064-4831-bcd3-6da1ad0dfb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b71f29d4-589b-473d-91fb-f9a2437f200d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:21 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e 1073741824 Sep 04 06:10:21 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0bd084-10dc-4b5e-9833-12fce8ef62d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume volume-b71f29d4-589b-473d-91fb-f9a2437f200d (b71f29d4-589b-473d-91fb-f9a2437f200d): created successfully Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0bd084-10dc-4b5e-9833-12fce8ef62d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Flow 'volume_create_manager' (bd26d87f-dca1-4192-ac18-209a48b3dba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cc9d9113-e2d8-4b9f-97d7-f0a4aa953e80 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Created volume successfully. Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Flow 'volume_create_manager' (69a34153-00f3-4aed-87db-80eca0ed81e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d320250-e5ca-4bfe-8e07-34cbb641d1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d320250-e5ca-4bfe-8e07-34cbb641d1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1868700346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0abd286-a8c4-4c1a-bed2-0198fe97abfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75840e86b0e543808200a2b9cdd0b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:22Z,use_quota=True,user_id='d527544acdcc480d99f78b13e0bd790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a810bc-cf23-4a87-8d05-ceb7570a51d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a810bc-cf23-4a87-8d05-ceb7570a51d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad67866-4d49-43d1-a232-efcbe8f7d38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad67866-4d49-43d1-a232-efcbe8f7d38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0abd286-a8c4-4c1a-bed2-0198fe97abfc', 'volume_name': 'volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13fcb4b-55b8-4b1c-95ff-7530439833c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13fcb4b-55b8-4b1c-95ff-7530439833c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10f1c91-ea09-48e8-ba85-e3696c8f0f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume f0abd286-a8c4-4c1a-bed2-0198fe97abfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc', 'volume_size': 1} Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:21 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e 1073741824" returned: 0 in 0.552s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Flow 'volume_create_manager' (2570d36e-8915-4d7d-bc36-e4f9e1f9ec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4adeb8-5669-41f0-9e39-842c66363e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:22 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e Sep 04 06:10:22 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4adeb8-5669-41f0-9e39-842c66363e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-4355171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea58bfe-54b1-453e-b3b1-ec11d4817b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75840e86b0e543808200a2b9cdd0b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:22Z,use_quota=True,user_id='d527544acdcc480d99f78b13e0bd790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fbc3b3-c3aa-4575-bf9b-2c8130c9a154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fbc3b3-c3aa-4575-bf9b-2c8130c9a154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517e6700-1bd7-44b9-9264-4bb1c61e0c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517e6700-1bd7-44b9-9264-4bb1c61e0c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea58bfe-54b1-453e-b3b1-ec11d4817b7c', 'volume_name': 'volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86185a94-daee-4ce2-bf7d-3dadcf2a7f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86185a94-daee-4ce2-bf7d-3dadcf2a7f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc080b5-3e1c-4c77-b1a3-00f7698b47c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume 6ea58bfe-54b1-453e-b3b1-ec11d4817b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c', 'volume_size': 1} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:22 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.234s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1732069208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b87b3c1-6881-418d-8c3b-2f7e98c39787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75840e86b0e543808200a2b9cdd0b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:21Z,use_quota=True,user_id='d527544acdcc480d99f78b13e0bd790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Creating volume 0b87b3c1-6881-418d-8c3b-2f7e98c39787 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:10:22 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0108619b-fe03-4c71-9079-1f8344ba3c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:22 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787 1073741824 Sep 04 06:10:22 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f3fd0f-28cd-4be4-b51e-9c18f5e20865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e (19d88d10-2d46-4ea1-91c5-c46eab4c869e): created successfully Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f3fd0f-28cd-4be4-b51e-9c18f5e20865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Flow 'volume_create_manager' (5fec50c9-793c-48d6-8cf1-1cb0927b691f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b9659e14-1280-433e-b779-2a80a2c6cb5b tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Created volume successfully. Sep 04 06:10:22 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787 1073741824" returned: 0 in 0.442s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:22 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787 Sep 04 06:10:22 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:23 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1868700346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0abd286-a8c4-4c1a-bed2-0198fe97abfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75840e86b0e543808200a2b9cdd0b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:22Z,use_quota=True,user_id='d527544acdcc480d99f78b13e0bd790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Creating volume f0abd286-a8c4-4c1a-bed2-0198fe97abfc {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:10:23 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7fbcea2-03c7-4c66-8014-71c48ced71f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:23 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc 1073741824 Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58afe4c4-9be3-49f3-946d-99e8e51866d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:23 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787 (0b87b3c1-6881-418d-8c3b-2f7e98c39787): created successfully Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58afe4c4-9be3-49f3-946d-99e8e51866d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Flow 'volume_create_manager' (a595c442-c146-434d-8252-47b4ff0a669a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0e503044-079c-47e2-b626-4822e5ca983c tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Created volume successfully. Sep 04 06:10:23 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc 1073741824" returned: 0 in 0.414s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:23 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc Sep 04 06:10:23 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:23 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.715s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-4355171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea58bfe-54b1-453e-b3b1-ec11d4817b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75840e86b0e543808200a2b9cdd0b0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:22Z,use_quota=True,user_id='d527544acdcc480d99f78b13e0bd790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Creating volume 6ea58bfe-54b1-453e-b3b1-ec11d4817b7c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:10:23 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:10:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10f1c91-ea09-48e8-ba85-e3696c8f0f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:24 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c 1073741824 Sep 04 06:10:24 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59df206e-a81a-4e56-b586-d9e4f7d43a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc (f0abd286-a8c4-4c1a-bed2-0198fe97abfc): created successfully Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59df206e-a81a-4e56-b586-d9e4f7d43a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Flow 'volume_create_manager' (69a34153-00f3-4aed-87db-80eca0ed81e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cdc76eb7-80d0-4646-9fbe-4710e37f70b9 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Created volume successfully. Sep 04 06:10:24 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c 1073741824" returned: 0 in 0.491s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:24 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c Sep 04 06:10:24 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:24 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc080b5-3e1c-4c77-b1a3-00f7698b47c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945d3e40-cf82-4de1-83af-bc387b7df9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Volume volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c (6ea58bfe-54b1-453e-b3b1-ec11d4817b7c): created successfully Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945d3e40-cf82-4de1-83af-bc387b7df9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Flow 'volume_create_manager' (2570d36e-8915-4d7d-bc36-e4f9e1f9ec4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-65c0b1cb-abab-4489-a90d-b2b97acb4ea5 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Created volume successfully. Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:25 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:25 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "cinder-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "cinder-quobyte-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-quobyte-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:25 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcf07c5-fbbf-47bd-ae00-e6f76012a34f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:25 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c Sep 04 06:10:25 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:25 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:25 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c Sep 04 06:10:25 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:26 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-quobyte-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c" released by "delete_volume" :: held 0.652s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Created reservations ['b6136741-f072-46ba-9ecd-426821ebb8c2', 'c17663a2-c864-49ec-ae4f-1e160881aa2a', 'cf1195bc-081c-4965-8e25-2dc2ca5dbde1', '7c67c933-7709-4688-a353-4c82efe21268'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:26 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:26 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:26 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Deleted volume successfully. Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "cinder-f0abd286-a8c4-4c1a-bed2-0198fe97abfc-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ed4c085d-21e0-4dbe-be78-578ef63012a3 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-6ea58bfe-54b1-453e-b3b1-ec11d4817b7c-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-f0abd286-a8c4-4c1a-bed2-0198fe97abfc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "cinder-quobyte-f0abd286-a8c4-4c1a-bed2-0198fe97abfc" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-quobyte-f0abd286-a8c4-4c1a-bed2-0198fe97abfc" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b56a4c5-44ea-4c3b-94d0-767d53b775fe]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:26 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc Sep 04 06:10:26 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:27 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:27 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc Sep 04 06:10:27 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:27 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f0abd286-a8c4-4c1a-bed2-0198fe97abfc" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-quobyte-f0abd286-a8c4-4c1a-bed2-0198fe97abfc" released by "delete_volume" :: held 0.765s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Created reservations ['3d808243-2468-414b-9cfb-8c1adab5138c', 'd13313a1-a674-4cbf-b1ea-37b88e375049', '6bdc0678-3398-4785-a091-f6ac0f12d38d', 'b235f106-cafd-4529-8887-329d026bd374'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:27 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:27 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "cinder-0b87b3c1-6881-418d-8c3b-2f7e98c39787-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-0b87b3c1-6881-418d-8c3b-2f7e98c39787-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "cinder-quobyte-0b87b3c1-6881-418d-8c3b-2f7e98c39787" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-quobyte-0b87b3c1-6881-418d-8c3b-2f7e98c39787" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:28 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.327s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Deleted volume successfully. Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b16edc-406e-42cb-b8cf-4bd8b5eb5a87]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b2d19601-8de5-47ea-8f82-060b8cb0fb67 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-f0abd286-a8c4-4c1a-bed2-0198fe97abfc-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:28 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787 Sep 04 06:10:28 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:28 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:28 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787 Sep 04 06:10:28 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:28 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0b87b3c1-6881-418d-8c3b-2f7e98c39787" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-quobyte-0b87b3c1-6881-418d-8c3b-2f7e98c39787" released by "delete_volume" :: held 0.702s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Created reservations ['8874e4ff-1528-4a1b-a0bd-c96548f1c295', '6950b0c7-bcd6-4f28-aa8f-e4c9088c2ac9', 'f8657e98-a0ce-4059-9ce6-9d871b1f7c55', '8e4a8e50-5382-4715-b38a-4201aa7719de'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:28 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:28 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "cinder-19d88d10-2d46-4ea1-91c5-c46eab4c869e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-19d88d10-2d46-4ea1-91c5-c46eab4c869e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:29 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.260s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Deleted volume successfully. Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "cinder-quobyte-19d88d10-2d46-4ea1-91c5-c46eab4c869e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fb725079-f801-4d5d-9db2-9ad794caaebc tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-0b87b3c1-6881-418d-8c3b-2f7e98c39787-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-quobyte-19d88d10-2d46-4ea1-91c5-c46eab4c869e" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d333b6e-247a-4775-ba62-429199e3eb06]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:29 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e Sep 04 06:10:29 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:29 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:29 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e Sep 04 06:10:29 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:29 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-19d88d10-2d46-4ea1-91c5-c46eab4c869e" returned: 0 in 0.260s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-quobyte-19d88d10-2d46-4ea1-91c5-c46eab4c869e" released by "delete_volume" :: held 0.686s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Created reservations ['c59ae89c-7f2c-43c6-afeb-47ad8bc9a20f', 'af9db0e7-d809-428a-965e-3e36708f758f', 'f954027a-ce28-4d08-afcf-07e90778d0ed', '723df403-4738-4efa-8da6-e9df600aeefa'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:30 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:30 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "cinder-b71f29d4-589b-473d-91fb-f9a2437f200d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-b71f29d4-589b-473d-91fb-f9a2437f200d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:30 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "cinder-quobyte-b71f29d4-589b-473d-91fb-f9a2437f200d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Deleted volume successfully. Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-quobyte-b71f29d4-589b-473d-91fb-f9a2437f200d" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f851ae21-5542-47f4-9b19-642b967b7b14 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-19d88d10-2d46-4ea1-91c5-c46eab4c869e-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c0cb71-6ee2-46e2-88d3-298cfad5a555]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b71f29d4-589b-473d-91fb-f9a2437f200d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:30 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b71f29d4-589b-473d-91fb-f9a2437f200d Sep 04 06:10:30 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:30 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b71f29d4-589b-473d-91fb-f9a2437f200d" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b71f29d4-589b-473d-91fb-f9a2437f200d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:30 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b71f29d4-589b-473d-91fb-f9a2437f200d Sep 04 06:10:30 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:31 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b71f29d4-589b-473d-91fb-f9a2437f200d" returned: 0 in 0.270s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-quobyte-b71f29d4-589b-473d-91fb-f9a2437f200d" released by "delete_volume" :: held 0.678s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Created reservations ['5281bbf9-fb0b-4673-ae1f-f4cbba6420f0', 'e0374797-b593-42c7-8179-5c9e4e48b59a', '11ba5836-3cce-4e84-b502-916df2a21d63', 'c29f7d0e-1c12-4d58-bda7-5585ee983a6c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:31 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:31 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:31 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Deleted volume successfully. Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-adf533b1-8028-40a0-a19c-964bb41071fa tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-b71f29d4-589b-473d-91fb-f9a2437f200d-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "cinder-30e56137-56dd-49f2-af4b-c6f724f0c076-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-30e56137-56dd-49f2-af4b-c6f724f0c076-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "cinder-quobyte-30e56137-56dd-49f2-af4b-c6f724f0c076" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-quobyte-30e56137-56dd-49f2-af4b-c6f724f0c076" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bfe4f0-b6c9-48fc-8f7b-c5f3d028fc20]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-30e56137-56dd-49f2-af4b-c6f724f0c076 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:31 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-30e56137-56dd-49f2-af4b-c6f724f0c076 Sep 04 06:10:31 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:32 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-30e56137-56dd-49f2-af4b-c6f724f0c076" returned: 0 in 0.403s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-30e56137-56dd-49f2-af4b-c6f724f0c076 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:32 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-30e56137-56dd-49f2-af4b-c6f724f0c076 Sep 04 06:10:32 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:32 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-30e56137-56dd-49f2-af4b-c6f724f0c076" returned: 0 in 0.254s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-quobyte-30e56137-56dd-49f2-af4b-c6f724f0c076" released by "delete_volume" :: held 0.697s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Created reservations ['d6f3bb6c-e6fb-4aa3-bed5-160cf068d4ac', '43c1ddf3-837e-4b57-b4a1-589890779be2', '62769a2e-9b28-4c1f-b930-c28e3ce4b28c', '419377b6-eb6f-4303-8cfa-1540364c2686'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:32 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:32 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:32 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Deleted volume successfully. Sep 04 06:10:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-66eff3d5-51d8-4d9f-a9bd-ee47613989c1 tempest-CreateVolumesFromSourceVolumeTest-116311072 None] Lock "cinder-30e56137-56dd-49f2-af4b-c6f724f0c076-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Flow 'volume_create_manager' (65ff203c-4a42-4418-9b6f-93e27f8cf5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e8ccdf-f57e-4c78-b75e-d937da485ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e8ccdf-f57e-4c78-b75e-d937da485ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc60a13-9602-4c00-b8ef-565fd4149757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac05a5a7b804419593f6efb2661459c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:36Z,use_quota=True,user_id='410a137392b2423cafd52bde09f59687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc875e2-afc8-4117-95e9-558e1c41070d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc875e2-afc8-4117-95e9-558e1c41070d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe48754a-98c2-477a-83d9-c5948bea0203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe48754a-98c2-477a-83d9-c5948bea0203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc60a13-9602-4c00-b8ef-565fd4149757', 'volume_name': 'volume-6cc60a13-9602-4c00-b8ef-565fd4149757', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f474e79-a088-42ba-947b-a3b85e835979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f474e79-a088-42ba-947b-a3b85e835979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02fe6a7-d7bd-45d6-9dda-f14f1f685fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Volume 6cc60a13-9602-4c00-b8ef-565fd4149757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc60a13-9602-4c00-b8ef-565fd4149757', 'volume_size': 1} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc60a13-9602-4c00-b8ef-565fd4149757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac05a5a7b804419593f6efb2661459c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:36Z,use_quota=True,user_id='410a137392b2423cafd52bde09f59687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Creating volume 6cc60a13-9602-4c00-b8ef-565fd4149757 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:10:35 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:10:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6cc60a13-9602-4c00-b8ef-565fd4149757 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:35 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6cc60a13-9602-4c00-b8ef-565fd4149757 1073741824 Sep 04 06:10:35 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:36 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6cc60a13-9602-4c00-b8ef-565fd4149757 1073741824" returned: 0 in 0.601s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6cc60a13-9602-4c00-b8ef-565fd4149757 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:36 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6cc60a13-9602-4c00-b8ef-565fd4149757 Sep 04 06:10:36 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:36 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6cc60a13-9602-4c00-b8ef-565fd4149757" returned: 0 in 0.272s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:10:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:36 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=94,cinder:INSERT=33,cinder:UPDATE=123,cinder:DELETE=10 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:10:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02fe6a7-d7bd-45d6-9dda-f14f1f685fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc60a13-9602-4c00-b8ef-565fd4149757', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50abe090-9c1f-4c30-b1d9-5ad70374bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:36 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=110,cinder:SELECT=95,cinder:INSERT=29,cinder:DELETE=8 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:10:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Volume volume-6cc60a13-9602-4c00-b8ef-565fd4149757 (6cc60a13-9602-4c00-b8ef-565fd4149757): created successfully Sep 04 06:10:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50abe090-9c1f-4c30-b1d9-5ad70374bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Flow 'volume_create_manager' (65ff203c-4a42-4418-9b6f-93e27f8cf5d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-43fa8b05-a328-424b-876c-3083cbea2aa3 tempest-CinderUnicodeTest-2128723522 None] Created volume successfully. Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Flow 'volume_create_manager' (9e53dc9b-dca8-4003-ae1c-ac778f136c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275068d0-839b-40a2-a04e-2d8b6b944e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275068d0-839b-40a2-a04e-2d8b6b944e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-724745569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15fe8b03-b228-49f4-9dd2-bb640c7ced70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac05a5a7b804419593f6efb2661459c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:38Z,use_quota=True,user_id='410a137392b2423cafd52bde09f59687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9071df-b53e-4ed2-b0d6-e87953c92d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9071df-b53e-4ed2-b0d6-e87953c92d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4641b64-db1a-4ae3-b99d-d55e54a7adb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4641b64-db1a-4ae3-b99d-d55e54a7adb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15fe8b03-b228-49f4-9dd2-bb640c7ced70', 'volume_name': 'volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4d581f-778e-4938-afff-ce0b2506a12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4d581f-778e-4938-afff-ce0b2506a12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b1a594-2243-4307-a68d-72d526037307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Volume 15fe8b03-b228-49f4-9dd2-bb640c7ced70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70', 'volume_size': 1} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-724745569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15fe8b03-b228-49f4-9dd2-bb640c7ced70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac05a5a7b804419593f6efb2661459c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:38Z,use_quota=True,user_id='410a137392b2423cafd52bde09f59687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Creating volume 15fe8b03-b228-49f4-9dd2-bb640c7ced70 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:10:38 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:38 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 1073741824 Sep 04 06:10:38 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:38 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 1073741824" returned: 0 in 0.509s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:39 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 Sep 04 06:10:39 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:39 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:10:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b1a594-2243-4307-a68d-72d526037307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bbe86a-f573-4061-ae7e-d7cf6422f444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Volume volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 (15fe8b03-b228-49f4-9dd2-bb640c7ced70): created successfully Sep 04 06:10:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bbe86a-f573-4061-ae7e-d7cf6422f444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Flow 'volume_create_manager' (9e53dc9b-dca8-4003-ae1c-ac778f136c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-862e7c05-08b0-4f87-922e-24208542f523 tempest-CinderUnicodeTest-2128723522 None] Created volume successfully. Sep 04 06:10:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] Creating offline snapshot 64a10b66-9f72-4d90-ac1f-3be1c493eac6 of volume 15fe8b03-b228-49f4-9dd2-bb640c7ced70 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:10:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ffe908-b102-4efd-8e44-54aed46caea3]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:40 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 Sep 04 06:10:40 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:41 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70" returned: 0 in 0.407s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:41 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 1G Sep 04 06:10:41 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:41 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 1G" returned: 0 in 0.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:41 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 Sep 04 06:10:41 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:41 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:41 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 is being set with open permissions: ugo+rw Sep 04 06:10:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:41 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 Sep 04 06:10:41 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:42 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:42 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.info Sep 04 06:10:42 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:42 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.info" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:42 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.info is being set with open permissions: ugo+rw Sep 04 06:10:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:42 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.info Sep 04 06:10:42 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:42 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.info" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-005f08c1-0b80-4cff-913b-5901a7c600eb tempest-CinderUnicodeTest-2128723522 None] Create snapshot completed successfully Sep 04 06:10:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "cinder-64a10b66-9f72-4d90-ac1f-3be1c493eac6-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-64a10b66-9f72-4d90-ac1f-3be1c493eac6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "cinder-quobyte-15fe8b03-b228-49f4-9dd2-bb640c7ced70" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-quobyte-15fe8b03-b228-49f4-9dd2-bb640c7ced70" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "cinder-quobyte-64a10b66-9f72-4d90-ac1f-3be1c493eac6" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-quobyte-64a10b66-9f72-4d90-ac1f-3be1c493eac6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Deleting offline snapshot 64a10b66-9f72-4d90-ac1f-3be1c493eac6 of volume 15fe8b03-b228-49f4-9dd2-bb640c7ced70 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:10:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] snapshot_file for this snap is: volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:10:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cce6d1-0349-4bea-9f76-75a7904048e3]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:44 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 Sep 04 06:10:44 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:44 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:10:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[daafba9f-4903-4b68-92e5-3e6fce63ecf0]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:44 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 Sep 04 06:10:44 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:44 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70" returned: 0 in 0.414s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:44 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 Sep 04 06:10:44 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:45 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6" returned: 0 in 0.433s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:45 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6 Sep 04 06:10:45 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:45 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70.64a10b66-9f72-4d90-ac1f-3be1c493eac6" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-quobyte-64a10b66-9f72-4d90-ac1f-3be1c493eac6" released by "_delete_snapshot" :: held 1.577s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-quobyte-15fe8b03-b228-49f4-9dd2-bb640c7ced70" released by "delete_snapshot" :: held 1.602s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:45 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Created reservations ['564c3851-6ab6-4a1a-85a5-c628f5105e0f', '2f0fbbb2-b85a-4fb8-8776-7170ec2526e7', '71acb0c5-5bf8-4aae-8755-6f4f897894e8', '025d22bd-e8a0-4123-ad05-aab8914631a8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Delete snapshot completed successfully. Sep 04 06:10:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f58815b2-b944-4375-ac4d-67dcd384e243 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-64a10b66-9f72-4d90-ac1f-3be1c493eac6-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "cinder-15fe8b03-b228-49f4-9dd2-bb640c7ced70-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-15fe8b03-b228-49f4-9dd2-bb640c7ced70-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "cinder-quobyte-15fe8b03-b228-49f4-9dd2-bb640c7ced70" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-quobyte-15fe8b03-b228-49f4-9dd2-bb640c7ced70" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a911f98-cd73-4578-8a65-6629b07d66b9]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:46 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 Sep 04 06:10:46 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:46 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:46 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70 Sep 04 06:10:46 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:46 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-15fe8b03-b228-49f4-9dd2-bb640c7ced70" returned: 0 in 0.250s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-quobyte-15fe8b03-b228-49f4-9dd2-bb640c7ced70" released by "delete_volume" :: held 0.703s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:46 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Created reservations ['86b66f27-cae7-46cb-8412-1713fa40dea1', '2152571e-fd48-4049-b14b-9fc8bf028819', '8eb62630-ae5a-4b98-8ec8-ae4ea64935ad', '02fe08ff-417e-4af8-802e-a13210ae4df2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:47 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:47 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "cinder-6cc60a13-9602-4c00-b8ef-565fd4149757-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-6cc60a13-9602-4c00-b8ef-565fd4149757-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:47 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.332s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "cinder-quobyte-6cc60a13-9602-4c00-b8ef-565fd4149757" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Deleted volume successfully. Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-quobyte-6cc60a13-9602-4c00-b8ef-565fd4149757" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c982eb5d-218f-44bd-b51c-025f010d5ce7 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-15fe8b03-b228-49f4-9dd2-bb640c7ced70-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d61143c-527c-4ec9-aa7d-2c7623134f37]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6cc60a13-9602-4c00-b8ef-565fd4149757 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:47 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6cc60a13-9602-4c00-b8ef-565fd4149757 Sep 04 06:10:47 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:47 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6cc60a13-9602-4c00-b8ef-565fd4149757" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6cc60a13-9602-4c00-b8ef-565fd4149757 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:47 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6cc60a13-9602-4c00-b8ef-565fd4149757 Sep 04 06:10:47 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:48 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6cc60a13-9602-4c00-b8ef-565fd4149757" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-quobyte-6cc60a13-9602-4c00-b8ef-565fd4149757" released by "delete_volume" :: held 0.733s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:48 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Created reservations ['0a0403de-186b-4b9d-9190-26aa8e88f667', '5c2f3ad0-98af-4f15-a97d-1963050ed111', 'c04eca68-9073-4452-810d-6f96bdce4e9f', '3ee9d78d-bb3a-4e01-9b15-33e865595c98'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:48 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:48 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:48 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:48 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Deleted volume successfully. Sep 04 06:10:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-538cd686-4951-42bc-af2a-0be38b1bff36 tempest-CinderUnicodeTest-2128723522 None] Lock "cinder-6cc60a13-9602-4c00-b8ef-565fd4149757-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Flow 'volume_create_manager' (ed78e31e-1692-4196-afd7-fc8fcc81ec7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4a5ebb-90e2-449e-b46d-6d46b796491d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4a5ebb-90e2-449e-b46d-6d46b796491d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1803154733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f937b7-337c-4283-b207-b0fa3356679e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169f8a6db7634537b29d7888b18c9c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:53Z,use_quota=True,user_id='68e3890fa36a49fb90ce4320b957062c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31c5b81-bf6e-4d43-b12a-cc75212b67f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31c5b81-bf6e-4d43-b12a-cc75212b67f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6476e328-93fe-44b7-bf8f-a408c77c79a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6476e328-93fe-44b7-bf8f-a408c77c79a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f937b7-337c-4283-b207-b0fa3356679e', 'volume_name': 'volume-26f937b7-337c-4283-b207-b0fa3356679e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fb4eac-f2a8-4232-ade9-58ac4b1d6e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fb4eac-f2a8-4232-ade9-58ac4b1d6e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc3784b-1404-4ddd-9dd1-92dd7d78c21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:52 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Volume 26f937b7-337c-4283-b207-b0fa3356679e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f937b7-337c-4283-b207-b0fa3356679e', 'volume_size': 1} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1803154733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f937b7-337c-4283-b207-b0fa3356679e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169f8a6db7634537b29d7888b18c9c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:53Z,use_quota=True,user_id='68e3890fa36a49fb90ce4320b957062c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Creating volume 26f937b7-337c-4283-b207-b0fa3356679e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:10:52 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:10:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-26f937b7-337c-4283-b207-b0fa3356679e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:52 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-26f937b7-337c-4283-b207-b0fa3356679e 1073741824 Sep 04 06:10:52 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:53 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-26f937b7-337c-4283-b207-b0fa3356679e 1073741824" returned: 0 in 0.465s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-26f937b7-337c-4283-b207-b0fa3356679e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:53 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-26f937b7-337c-4283-b207-b0fa3356679e Sep 04 06:10:53 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:53 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-26f937b7-337c-4283-b207-b0fa3356679e" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:10:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc3784b-1404-4ddd-9dd1-92dd7d78c21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f937b7-337c-4283-b207-b0fa3356679e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d26a4a-7a68-4994-a753-7923c63996d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:53 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Volume volume-26f937b7-337c-4283-b207-b0fa3356679e (26f937b7-337c-4283-b207-b0fa3356679e): created successfully Sep 04 06:10:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d26a4a-7a68-4994-a753-7923c63996d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Flow 'volume_create_manager' (ed78e31e-1692-4196-afd7-fc8fcc81ec7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c31350e3-61bc-47eb-ad1d-2f554809f80b tempest-ProjectReaderTests-1599931688 None] Created volume successfully. Sep 04 06:10:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Acquiring lock "cinder-26f937b7-337c-4283-b207-b0fa3356679e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Lock "cinder-26f937b7-337c-4283-b207-b0fa3356679e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Acquiring lock "cinder-quobyte-26f937b7-337c-4283-b207-b0fa3356679e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Lock "cinder-quobyte-26f937b7-337c-4283-b207-b0fa3356679e" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c285b6c-013b-48e3-8cf1-fd45400bc8b9]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-26f937b7-337c-4283-b207-b0fa3356679e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:55 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-26f937b7-337c-4283-b207-b0fa3356679e Sep 04 06:10:55 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:55 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-26f937b7-337c-4283-b207-b0fa3356679e" returned: 0 in 0.401s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-26f937b7-337c-4283-b207-b0fa3356679e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:55 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-26f937b7-337c-4283-b207-b0fa3356679e Sep 04 06:10:55 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:55 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-26f937b7-337c-4283-b207-b0fa3356679e" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Lock "cinder-quobyte-26f937b7-337c-4283-b207-b0fa3356679e" released by "delete_volume" :: held 0.717s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Created reservations ['910993f9-cc71-4163-8cf6-50ea600513cc', '89dbf4eb-34e1-44db-b667-45f04bbd3bb9', 'e2e9060d-0dea-4a5f-a3b7-610634f256ae', '1faa7bb6-ec8c-45ca-9b68-bee7bef3be7f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:56 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:10:56 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:56 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:10:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Deleted volume successfully. Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0fff9cd3-fed7-42a7-a884-7a0ac037e5ff tempest-ProjectReaderTests-1599931688 None] Lock "cinder-26f937b7-337c-4283-b207-b0fa3356679e-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Flow 'volume_create_manager' (0bfcc91c-82ac-433e-a8d4-4b966cc9d2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8bfab4-ab8f-4d34-ba4f-50ba8d6ef810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8bfab4-ab8f-4d34-ba4f-50ba8d6ef810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1340969125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c9c372-e299-4091-afe0-6d2f45168cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169f8a6db7634537b29d7888b18c9c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:57Z,use_quota=True,user_id='68e3890fa36a49fb90ce4320b957062c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fed6c50-35a4-4468-9a40-94f3e2582678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fed6c50-35a4-4468-9a40-94f3e2582678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8c8de4-9e65-4bac-a614-d6d8f072c26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8c8de4-9e65-4bac-a614-d6d8f072c26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c9c372-e299-4091-afe0-6d2f45168cb1', 'volume_name': 'volume-46c9c372-e299-4091-afe0-6d2f45168cb1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf474c4f-3aec-4983-b4b2-5a4ba30f63b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf474c4f-3aec-4983-b4b2-5a4ba30f63b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830b284b-9234-47c6-be92-12a91fde2878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Volume 46c9c372-e299-4091-afe0-6d2f45168cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c9c372-e299-4091-afe0-6d2f45168cb1', 'volume_size': 1} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1340969125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c9c372-e299-4091-afe0-6d2f45168cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169f8a6db7634537b29d7888b18c9c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:57Z,use_quota=True,user_id='68e3890fa36a49fb90ce4320b957062c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Creating volume 46c9c372-e299-4091-afe0-6d2f45168cb1 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:10:56 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:10:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-46c9c372-e299-4091-afe0-6d2f45168cb1 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:56 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-46c9c372-e299-4091-afe0-6d2f45168cb1 1073741824 Sep 04 06:10:56 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:57 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-46c9c372-e299-4091-afe0-6d2f45168cb1 1073741824" returned: 0 in 0.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-46c9c372-e299-4091-afe0-6d2f45168cb1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:57 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-46c9c372-e299-4091-afe0-6d2f45168cb1 Sep 04 06:10:57 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:57 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-46c9c372-e299-4091-afe0-6d2f45168cb1" returned: 0 in 0.299s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:10:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:10:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830b284b-9234-47c6-be92-12a91fde2878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c9c372-e299-4091-afe0-6d2f45168cb1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dbd028-72d9-4491-8630-5755f2663838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:10:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Volume volume-46c9c372-e299-4091-afe0-6d2f45168cb1 (46c9c372-e299-4091-afe0-6d2f45168cb1): created successfully Sep 04 06:10:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dbd028-72d9-4491-8630-5755f2663838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:10:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Flow 'volume_create_manager' (0bfcc91c-82ac-433e-a8d4-4b966cc9d2fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:10:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5637eed7-50a6-44f6-bce5-669f955b8623 tempest-ProjectReaderTests-1599931688 None] Created volume successfully. Sep 04 06:10:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Acquiring lock "cinder-46c9c372-e299-4091-afe0-6d2f45168cb1-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Lock "cinder-46c9c372-e299-4091-afe0-6d2f45168cb1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Acquiring lock "cinder-quobyte-46c9c372-e299-4091-afe0-6d2f45168cb1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:10:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Lock "cinder-quobyte-46c9c372-e299-4091-afe0-6d2f45168cb1" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:10:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3265ee76-cd3a-471d-bb2a-78f98f2d5edc]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:10:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-46c9c372-e299-4091-afe0-6d2f45168cb1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:59 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-46c9c372-e299-4091-afe0-6d2f45168cb1 Sep 04 06:10:59 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:10:59 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 04 06:10:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-46c9c372-e299-4091-afe0-6d2f45168cb1" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:10:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-46c9c372-e299-4091-afe0-6d2f45168cb1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:10:59 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-46c9c372-e299-4091-afe0-6d2f45168cb1 Sep 04 06:10:59 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:11:00 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 04 06:11:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-46c9c372-e299-4091-afe0-6d2f45168cb1" returned: 0 in 0.272s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:11:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Lock "cinder-quobyte-46c9c372-e299-4091-afe0-6d2f45168cb1" released by "delete_volume" :: held 0.765s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:11:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Created reservations ['1e935c5b-bc28-495f-9ada-e1002d547fc5', '97450125-c1c6-4b42-854c-fb3445fcad32', '2a97d941-9540-4041-8367-85ed7d9cc732', '1350e356-f87b-4c56-8508-8ace3c266744'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:11:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:11:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:11:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:11:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:11:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:11:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:11:00 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:11:00 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:11:00 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Sep 04 06:11:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.281s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:11:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:11:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Deleted volume successfully. Sep 04 06:11:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d2884bf-b93b-4612-9d01-9870810fc3ab tempest-ProjectReaderTests-1599931688 None] Lock "cinder-46c9c372-e299-4091-afe0-6d2f45168cb1-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:11:10 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=34,cinder:UPDATE=50,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:11:10 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=47,cinder:DELETE=6,cinder:SELECT=36,cinder:INSERT=16 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Flow 'volume_create_manager' (1c534dd0-0b4f-4b5b-8e37-4415f1fa7384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70a1cd4-3c2e-4bc7-a824-5d5d5ad800c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70a1cd4-3c2e-4bc7-a824-5d5d5ad800c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1080927555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eb54c46968e429996a1dc33d2bae83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:22Z,use_quota=True,user_id='3e6d2e29f40b40c9b1af5205949213f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0623d9bc-432b-4adf-89e4-14e262af465f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0623d9bc-432b-4adf-89e4-14e262af465f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc6c790-68af-42ad-9330-1e274e792d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc6c790-68af-42ad-9330-1e274e792d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e', 'volume_name': 'volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a88724c-0eca-4005-98f4-9abb02734663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a88724c-0eca-4005-98f4-9abb02734663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a048b2e5-a0a6-409d-a2b5-9e8c6a721428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:11:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Volume 3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e', 'volume_size': 1} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1080927555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eb54c46968e429996a1dc33d2bae83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:22Z,use_quota=True,user_id='3e6d2e29f40b40c9b1af5205949213f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Creating volume 3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:11:22 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:11:22 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e 1073741824 Sep 04 06:11:22 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:11:22 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Sep 04 06:11:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e 1073741824" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:11:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:11:23 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e Sep 04 06:11:23 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:11:23 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Sep 04 06:11:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:11:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:11:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:11:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a048b2e5-a0a6-409d-a2b5-9e8c6a721428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:11:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1f0834-a3d4-4f48-af88-d82ce67be006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:11:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Volume volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e (3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e): created successfully Sep 04 06:11:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1f0834-a3d4-4f48-af88-d82ce67be006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:11:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Flow 'volume_create_manager' (1c534dd0-0b4f-4b5b-8e37-4415f1fa7384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:11:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-17aa65d0-5acc-4a5b-b9fc-93666c043274 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Created volume successfully. Sep 04 06:11:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-907c42bb-bc69-45dc-85b1-ddbd4b902623 req-d77159bb-9030-4278-9a40-144c029c408d tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:11:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-907c42bb-bc69-45dc-85b1-ddbd4b902623 req-d77159bb-9030-4278-9a40-144c029c408d tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:11:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-907c42bb-bc69-45dc-85b1-ddbd4b902623 req-d77159bb-9030-4278-9a40-144c029c408d tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:11:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-907c42bb-bc69-45dc-85b1-ddbd4b902623 req-d77159bb-9030-4278-9a40-144c029c408d tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fc95fa8-4aed-4e03-a16f-22be2b601446', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:11:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-907c42bb-bc69-45dc-85b1-ddbd4b902623 req-d77159bb-9030-4278-9a40-144c029c408d tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] attachment_update completed successfully. Sep 04 06:11:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:11:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:11:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:11:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:11:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:11:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:11:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:11:25 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:11:25 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:11:25 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 04 06:11:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:11:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:11:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:11:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:11:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:11:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-2aaa20e3-40f8-4908-b77e-8cd1513cccee req-a0e13041-c5a3-4e3c-80d2-fcd410850006 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Terminate volume connection completed successfully. Sep 04 06:11:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2aaa20e3-40f8-4908-b77e-8cd1513cccee req-a0e13041-c5a3-4e3c-80d2-fcd410850006 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Deleting attachment 9fc95fa8-4aed-4e03-a16f-22be2b601446. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:11:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Acquiring lock "cinder-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:11:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Lock "cinder-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:11:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Acquiring lock "cinder-quobyte-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:11:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Lock "cinder-quobyte-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:11:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e782d683-88c5-4087-bfeb-8afa351b630f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:11:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:11:27 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e Sep 04 06:11:27 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:11:28 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:11:28 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e Sep 04 06:11:28 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:11:28 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e" returned: 0 in 0.241s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Lock "cinder-quobyte-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e" released by "delete_volume" :: held 0.634s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Created reservations ['d2b8e147-16f3-4759-9469-f5055db7c675', '89d4b04c-0855-40cb-8927-30509952045a', 'f85737cf-64f0-4be3-bd6b-664650ae7d0d', '727a8a1a-3cfa-47a6-9df9-9f9f6007496b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:11:28 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:11:28 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:11:28 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.234s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:11:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Deleted volume successfully. Sep 04 06:11:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43033348-87c8-484b-a748-38dc92a9e4e8 tempest-TestServerVolumeAttachScenarioOldVersion-2020263919 None] Lock "cinder-3dc92337-d1fb-43ae-b5b0-7c7f81d6b92e-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:11:38 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=13,cinder:SELECT=16,cinder:INSERT=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:11:38 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:11:54 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Flow 'volume_create_manager' (8c472ba0-7836-40ae-bc54-cc271f0b1380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bc6d25-5705-4653-896d-765e2e55bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bc6d25-5705-4653-896d-765e2e55bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-617910736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c20ffd-4539-4fe6-bf7a-7cacff222fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf8a4ed364445629adb8afd502d900b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:03Z,use_quota=True,user_id='a0635265ad234002aaf9dfae9e61580e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9815fda2-2e9e-4054-8464-cc49589654b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9815fda2-2e9e-4054-8464-cc49589654b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c59075-2465-4340-ae13-20e8c7fdf684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c59075-2465-4340-ae13-20e8c7fdf684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c20ffd-4539-4fe6-bf7a-7cacff222fd0', 'volume_name': 'volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2369c57c-ff24-4604-9b25-ce1f0d9176c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2369c57c-ff24-4604-9b25-ce1f0d9176c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de0557e-ddc2-4b12-8f34-8dca78132d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:12:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Volume 09c20ffd-4539-4fe6-bf7a-7cacff222fd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0', 'volume_size': 1} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-617910736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c20ffd-4539-4fe6-bf7a-7cacff222fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf8a4ed364445629adb8afd502d900b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:03Z,use_quota=True,user_id='a0635265ad234002aaf9dfae9e61580e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Creating volume 09c20ffd-4539-4fe6-bf7a-7cacff222fd0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:12:03 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:12:03 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0 1073741824 Sep 04 06:12:03 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Flow 'volume_create_manager' (3e00d355-dd3a-43a0-8b6f-f7dbaf1566ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c644d674-1af0-4522-988e-73ab440b1ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c644d674-1af0-4522-988e-73ab440b1ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1056278597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58adf509-95bf-48af-bdce-2c1676c740ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf8a4ed364445629adb8afd502d900b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:03Z,use_quota=True,user_id='a0635265ad234002aaf9dfae9e61580e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035ddbeb-31fd-4082-83e4-f82224ea5b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035ddbeb-31fd-4082-83e4-f82224ea5b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f18461b-e3ae-49f2-bdb2-918dda8d9229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f18461b-e3ae-49f2-bdb2-918dda8d9229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58adf509-95bf-48af-bdce-2c1676c740ac', 'volume_name': 'volume-58adf509-95bf-48af-bdce-2c1676c740ac', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e1d32e-dbbb-4b97-a483-98756da93212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e1d32e-dbbb-4b97-a483-98756da93212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f867ca37-eb02-4753-82ec-58b6631af926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:12:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Volume 58adf509-95bf-48af-bdce-2c1676c740ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58adf509-95bf-48af-bdce-2c1676c740ac', 'volume_size': 1} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:12:03 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0 1073741824" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:12:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:12:03 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0 Sep 04 06:12:03 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:12:04 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1056278597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58adf509-95bf-48af-bdce-2c1676c740ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf8a4ed364445629adb8afd502d900b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:03Z,use_quota=True,user_id='a0635265ad234002aaf9dfae9e61580e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Creating volume 58adf509-95bf-48af-bdce-2c1676c740ac {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:12:04 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58adf509-95bf-48af-bdce-2c1676c740ac 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de0557e-ddc2-4b12-8f34-8dca78132d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:12:04 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58adf509-95bf-48af-bdce-2c1676c740ac 1073741824 Sep 04 06:12:04 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2733cc-6ddb-4c82-b28b-df9688ed05ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:12:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Volume volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0 (09c20ffd-4539-4fe6-bf7a-7cacff222fd0): created successfully Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2733cc-6ddb-4c82-b28b-df9688ed05ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Flow 'volume_create_manager' (8c472ba0-7836-40ae-bc54-cc271f0b1380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:12:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1772c58d-194e-459c-9cda-1904502cc212 tempest-TestServerVolumeAttachmentScenario-245228251 None] Created volume successfully. Sep 04 06:12:04 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58adf509-95bf-48af-bdce-2c1676c740ac 1073741824" returned: 0 in 0.453s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58adf509-95bf-48af-bdce-2c1676c740ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:12:04 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58adf509-95bf-48af-bdce-2c1676c740ac Sep 04 06:12:04 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:12:04 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58adf509-95bf-48af-bdce-2c1676c740ac" returned: 0 in 0.248s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f867ca37-eb02-4753-82ec-58b6631af926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58adf509-95bf-48af-bdce-2c1676c740ac', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73246323-1fe7-4be2-9487-68fb62d449c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:12:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Volume volume-58adf509-95bf-48af-bdce-2c1676c740ac (58adf509-95bf-48af-bdce-2c1676c740ac): created successfully Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73246323-1fe7-4be2-9487-68fb62d449c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:12:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Flow 'volume_create_manager' (3e00d355-dd3a-43a0-8b6f-f7dbaf1566ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:12:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8abcc3c8-e368-4ff3-995d-01d56f3c882f tempest-TestServerVolumeAttachmentScenario-245228251 None] Created volume successfully. Sep 04 06:12:14 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:12:14 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=3,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:12:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:12:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:12:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:12:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:12:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:12:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:12:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:12:25 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:12:25 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:12:25 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Sep 04 06:12:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:12:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:12:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:12:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:12:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:12:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-5f88498c-19f8-48a5-b98d-d78668f1f40f req-7b1c2649-1d11-45b7-9e09-eca37c57699a tempest-TestServerVolumeAttachmentScenario-245228251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:12:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-5f88498c-19f8-48a5-b98d-d78668f1f40f req-7b1c2649-1d11-45b7-9e09-eca37c57699a tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:12:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-5f88498c-19f8-48a5-b98d-d78668f1f40f req-7b1c2649-1d11-45b7-9e09-eca37c57699a tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:12:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-5f88498c-19f8-48a5-b98d-d78668f1f40f req-7b1c2649-1d11-45b7-9e09-eca37c57699a tempest-TestServerVolumeAttachmentScenario-245228251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8712de8-b2cc-44b3-9710-39e8491c2478', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:12:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-5f88498c-19f8-48a5-b98d-d78668f1f40f req-7b1c2649-1d11-45b7-9e09-eca37c57699a tempest-TestServerVolumeAttachmentScenario-245228251 None] attachment_update completed successfully. Sep 04 06:12:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-e3e0c6ee-8558-4c96-962c-94a1fb93c484 req-c462204f-6d4b-49ff-8194-f5b9c5143945 tempest-TestServerVolumeAttachmentScenario-245228251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:12:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-e3e0c6ee-8558-4c96-962c-94a1fb93c484 req-c462204f-6d4b-49ff-8194-f5b9c5143945 tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:12:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-e3e0c6ee-8558-4c96-962c-94a1fb93c484 req-c462204f-6d4b-49ff-8194-f5b9c5143945 tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:12:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-e3e0c6ee-8558-4c96-962c-94a1fb93c484 req-c462204f-6d4b-49ff-8194-f5b9c5143945 tempest-TestServerVolumeAttachmentScenario-245228251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-58adf509-95bf-48af-bdce-2c1676c740ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18ad0b88-7fcb-4d17-a2ec-42a0a98f7c9b', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:12:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-e3e0c6ee-8558-4c96-962c-94a1fb93c484 req-c462204f-6d4b-49ff-8194-f5b9c5143945 tempest-TestServerVolumeAttachmentScenario-245228251 None] attachment_update completed successfully. Sep 04 06:12:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-4ba702e9-4d10-4145-b22b-7debf1fb7753 req-3cca3a12-bc26-4128-aca6-e8bfd28a7ed1 tempest-TestServerVolumeAttachmentScenario-245228251 None] Terminate volume connection completed successfully. Sep 04 06:12:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-4ba702e9-4d10-4145-b22b-7debf1fb7753 req-3cca3a12-bc26-4128-aca6-e8bfd28a7ed1 tempest-TestServerVolumeAttachmentScenario-245228251 None] Deleting attachment 18ad0b88-7fcb-4d17-a2ec-42a0a98f7c9b. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:12:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-c8b18ab1-c2bd-4670-a74b-6333bea05543 req-e2c136eb-d43f-42ef-bc78-ec0a269d4961 tempest-TestServerVolumeAttachmentScenario-245228251 None] Terminate volume connection completed successfully. Sep 04 06:12:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-c8b18ab1-c2bd-4670-a74b-6333bea05543 req-e2c136eb-d43f-42ef-bc78-ec0a269d4961 tempest-TestServerVolumeAttachmentScenario-245228251 None] Deleting attachment a8712de8-b2cc-44b3-9710-39e8491c2478. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:12:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Acquiring lock "cinder-58adf509-95bf-48af-bdce-2c1676c740ac-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:12:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "cinder-58adf509-95bf-48af-bdce-2c1676c740ac-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:12:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Acquiring lock "cinder-quobyte-58adf509-95bf-48af-bdce-2c1676c740ac" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:12:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "cinder-quobyte-58adf509-95bf-48af-bdce-2c1676c740ac" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:12:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b2275c-3933-46d7-9268-3e90dac6beca]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58adf509-95bf-48af-bdce-2c1676c740ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:12:45 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58adf509-95bf-48af-bdce-2c1676c740ac Sep 04 06:12:45 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:12:46 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58adf509-95bf-48af-bdce-2c1676c740ac" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58adf509-95bf-48af-bdce-2c1676c740ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:12:46 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58adf509-95bf-48af-bdce-2c1676c740ac Sep 04 06:12:46 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:12:46 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-58adf509-95bf-48af-bdce-2c1676c740ac" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "cinder-quobyte-58adf509-95bf-48af-bdce-2c1676c740ac" released by "delete_volume" :: held 0.631s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Created reservations ['d56c93af-0001-4365-9637-1f3de8368d7b', '75076885-28c3-4f6b-8957-b9b581f439b0', 'f4a31d4e-8305-4474-9fc8-46ea144e75b1', 'a44885a0-f882-4a5b-9bba-85e3ab2e742c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:12:46 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:12:46 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:12:46 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.229s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:12:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Deleted volume successfully. Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09938480-8ed5-4727-b754-7e84a47411bf tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "cinder-58adf509-95bf-48af-bdce-2c1676c740ac-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Acquiring lock "cinder-09c20ffd-4539-4fe6-bf7a-7cacff222fd0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "cinder-09c20ffd-4539-4fe6-bf7a-7cacff222fd0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Acquiring lock "cinder-quobyte-09c20ffd-4539-4fe6-bf7a-7cacff222fd0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "cinder-quobyte-09c20ffd-4539-4fe6-bf7a-7cacff222fd0" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e00ac2-e150-4bd2-b883-24dbfa0437cc]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:12:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:12:47 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0 Sep 04 06:12:47 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:12:47 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0" returned: 0 in 0.355s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:12:47 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0 Sep 04 06:12:47 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:12:47 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-09c20ffd-4539-4fe6-bf7a-7cacff222fd0" returned: 0 in 0.240s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "cinder-quobyte-09c20ffd-4539-4fe6-bf7a-7cacff222fd0" released by "delete_volume" :: held 0.635s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Created reservations ['90eaad92-1a83-4edf-bf44-3c2861423527', '17d6d9c3-6f0c-480a-ad6f-8dcffca26884', '066b771c-831b-4efc-8ba6-8b573175cd04', 'ca7a4d1d-761f-4824-9c6e-3dc0062a75b9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:12:47 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:12:47 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:12:47 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:12:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Deleted volume successfully. Sep 04 06:12:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27cd736d-0e92-44dc-aff1-4c062822fee8 tempest-TestServerVolumeAttachmentScenario-245228251 None] Lock "cinder-09c20ffd-4539-4fe6-bf7a-7cacff222fd0-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:12:57 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=26,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:12:57 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Flow 'volume_create_manager' (dade4d45-277e-4219-a799-76b48391a180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0256c4-c3cf-4562-b2e6-a212f2ea7439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0256c4-c3cf-4562-b2e6-a212f2ea7439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-634837389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb325b3-7d8c-42c9-b21f-c6784de5c82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed0c583515e4a138c0b58853a5371bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:20Z,use_quota=True,user_id='0ddbfb26e6bb4cdb803e1f74ea5a1540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1eb1d9-8104-462a-b055-7e807463b2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1eb1d9-8104-462a-b055-7e807463b2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a537a403-dada-43b9-8d15-e779afa55b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a537a403-dada-43b9-8d15-e779afa55b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb325b3-7d8c-42c9-b21f-c6784de5c82c', 'volume_name': 'volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a54353-e8b5-44d8-8054-fc620a1a6959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a54353-e8b5-44d8-8054-fc620a1a6959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1592aa98-5187-4e8f-8e5c-7ce5a3a04606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:13:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Volume ecb325b3-7d8c-42c9-b21f-c6784de5c82c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c', 'volume_size': 1} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-634837389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb325b3-7d8c-42c9-b21f-c6784de5c82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed0c583515e4a138c0b58853a5371bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:20Z,use_quota=True,user_id='0ddbfb26e6bb4cdb803e1f74ea5a1540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Creating volume ecb325b3-7d8c-42c9-b21f-c6784de5c82c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:13:20 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:13:20 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c 1073741824 Sep 04 06:13:20 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:13:20 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c 1073741824" returned: 0 in 0.442s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:13:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:13:21 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c Sep 04 06:13:21 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:13:21 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Sep 04 06:13:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c" returned: 0 in 0.295s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:13:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:13:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:13:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1592aa98-5187-4e8f-8e5c-7ce5a3a04606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:13:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705683d9-fa54-4e43-a5b8-62795454bd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:13:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Volume volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c (ecb325b3-7d8c-42c9-b21f-c6784de5c82c): created successfully Sep 04 06:13:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705683d9-fa54-4e43-a5b8-62795454bd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:13:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Flow 'volume_create_manager' (dade4d45-277e-4219-a799-76b48391a180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:13:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-55cdee5a-74a6-4af4-bc99-bb57b42f15d5 tempest-TestStampPattern-1913670803 None] Created volume successfully. Sep 04 06:13:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:13:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:13:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:13:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:13:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:13:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:13:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:13:25 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:13:25 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:13:25 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 04 06:13:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:13:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:13:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:13:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:13:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:13:31 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:13:31 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:13:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-fd4eb4da-4506-4593-acac-a8612829be42 req-78231cd8-d822-49de-b563-a1b64d148a4c tempest-TestStampPattern-1913670803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:13:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-fd4eb4da-4506-4593-acac-a8612829be42 req-78231cd8-d822-49de-b563-a1b64d148a4c tempest-TestStampPattern-1913670803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:13:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-fd4eb4da-4506-4593-acac-a8612829be42 req-78231cd8-d822-49de-b563-a1b64d148a4c tempest-TestStampPattern-1913670803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:13:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-fd4eb4da-4506-4593-acac-a8612829be42 req-78231cd8-d822-49de-b563-a1b64d148a4c tempest-TestStampPattern-1913670803 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3f27853-435e-408a-b4e7-f5c08fbb6d37', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:13:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-fd4eb4da-4506-4593-acac-a8612829be42 req-78231cd8-d822-49de-b563-a1b64d148a4c tempest-TestStampPattern-1913670803 None] attachment_update completed successfully. Sep 04 06:13:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-8c1dc685-7d72-44cc-933e-160e2d23e7c4 req-1b0c8df9-93f6-4a65-9681-0a4f339c697e tempest-TestStampPattern-1913670803 None] Terminate volume connection completed successfully. Sep 04 06:13:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-8c1dc685-7d72-44cc-933e-160e2d23e7c4 req-1b0c8df9-93f6-4a65-9681-0a4f339c697e tempest-TestStampPattern-1913670803 None] Deleting attachment e3f27853-435e-408a-b4e7-f5c08fbb6d37. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:13:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:13:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:13:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] Creating offline snapshot 25c73df9-d9ad-44cc-b304-39f3e77df852 of volume ecb325b3-7d8c-42c9-b21f-c6784de5c82c {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:13:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a037c7e-4061-446b-a086-13777e7cecdf]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:13:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:13:55 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c Sep 04 06:13:55 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:13:55 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Sep 04 06:13:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:13:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:13:55 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 1G Sep 04 06:13:55 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:13:55 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Sep 04 06:13:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 1G" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:13:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:13:55 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 Sep 04 06:13:55 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:13:56 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Sep 04 06:13:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:13:56 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 is being set with open permissions: ugo+rw Sep 04 06:13:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:13:56 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 Sep 04 06:13:56 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:13:56 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Sep 04 06:13:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:13:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:13:56 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.info Sep 04 06:13:56 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:13:56 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Sep 04 06:13:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.info" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:13:56 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.info is being set with open permissions: ugo+rw Sep 04 06:13:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:13:56 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.info Sep 04 06:13:56 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:13:57 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Sep 04 06:13:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.info" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:13:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:13:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9b0cccb1-23bb-449d-9a1e-031289dcf816 tempest-TestStampPattern-1913670803 None] Create snapshot completed successfully Sep 04 06:14:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Flow 'volume_create_manager' (144b556d-3c3a-4a4e-b617-f8ba07986480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab46e22-47fc-454f-ab11-918b07470eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab46e22-47fc-454f-ab11-918b07470eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-359725828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11e86a2-578e-4456-b538-3f7bb7e9b496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed0c583515e4a138c0b58853a5371bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=25c73df9-d9ad-44cc-b304-39f3e77df852,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:04Z,use_quota=True,user_id='0ddbfb26e6bb4cdb803e1f74ea5a1540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2607df-b538-4e30-9206-ca6ab601c37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2607df-b538-4e30-9206-ca6ab601c37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9b79a9-31cb-490d-b1fc-c89787a9e020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9b79a9-31cb-490d-b1fc-c89787a9e020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e11e86a2-578e-4456-b538-3f7bb7e9b496', 'volume_name': 'volume-e11e86a2-578e-4456-b538-3f7bb7e9b496', 'volume_size': 1, 'snapshot_id': '25c73df9-d9ad-44cc-b304-39f3e77df852'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be988a1-0383-4c75-833d-460523c1290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be988a1-0383-4c75-833d-460523c1290a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3fdebc-de1d-4f9c-8842-40ac2bb66501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:14:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Volume e11e86a2-578e-4456-b538-3f7bb7e9b496: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e11e86a2-578e-4456-b538-3f7bb7e9b496', 'volume_size': 1, 'snapshot_id': '25c73df9-d9ad-44cc-b304-39f3e77df852'} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Acquiring lock "cinder-quobyte-25c73df9-d9ad-44cc-b304-39f3e77df852-e11e86a2-578e-4456-b538-3f7bb7e9b496" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Lock "cinder-quobyte-25c73df9-d9ad-44cc-b304-39f3e77df852-e11e86a2-578e-4456-b538-3f7bb7e9b496" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Creating volume e11e86a2-578e-4456-b538-3f7bb7e9b496 from snapshot 25c73df9-d9ad-44cc-b304-39f3e77df852 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Acquiring lock "cinder-quobyte-e11e86a2-578e-4456-b538-3f7bb7e9b496" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Lock "cinder-quobyte-e11e86a2-578e-4456-b538-3f7bb7e9b496" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] snapshot: 25c73df9-d9ad-44cc-b304-39f3e77df852, volume: e11e86a2-578e-4456-b538-3f7bb7e9b496, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed438642-3059-40ed-b36a-246bcf078681]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:14:04 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 Sep 04 06:14:04 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:14:04 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852" returned: 0 in 0.385s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[17937c2b-5c79-476f-a9c7-64fa0515e0c0]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:14:04 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c Sep 04 06:14:04 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:14:05 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Sep 04 06:14:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c" returned: 0 in 0.388s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:14:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 06:14:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 06:14:05 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Path /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 06:14:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:14:05 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496 Sep 04 06:14:05 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:14:10 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 04 06:14:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496" returned: 0 in 5.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:14:10 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:14:10 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Converted 1024.00 MB image at 191.10 MB/s Sep 04 06:14:10 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496 is being set with open permissions: ugo+rw Sep 04 06:14:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:14:10 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496 Sep 04 06:14:10 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:14:10 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 04 06:14:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:14:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Lock "cinder-quobyte-e11e86a2-578e-4456-b538-3f7bb7e9b496" released by "_copy_volume_from_snapshot" :: held 6.484s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:14:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Lock "cinder-quobyte-25c73df9-d9ad-44cc-b304-39f3e77df852-e11e86a2-578e-4456-b538-3f7bb7e9b496" released by "_create_volume_from_snapshot" :: held 6.563s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:14:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.581s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:14:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3fdebc-de1d-4f9c-8842-40ac2bb66501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11e86a2-578e-4456-b538-3f7bb7e9b496', 'volume_size': 1, 'snapshot_id': '25c73df9-d9ad-44cc-b304-39f3e77df852'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:14:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2a04dc-4faf-4aa2-af1a-3a7b09e4fd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:14:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Volume volume-e11e86a2-578e-4456-b538-3f7bb7e9b496 (e11e86a2-578e-4456-b538-3f7bb7e9b496): created successfully Sep 04 06:14:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2a04dc-4faf-4aa2-af1a-3a7b09e4fd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:14:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Flow 'volume_create_manager' (144b556d-3c3a-4a4e-b617-f8ba07986480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:14:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e447f8bb-938d-4aa9-808d-0e10ec069dc7 tempest-TestStampPattern-1913670803 None] Created volume successfully. Sep 04 06:14:20 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=10,cinder:SELECT=12,cinder:INSERT=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:14:20 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=18,cinder:UPDATE=3,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:14:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:14:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:14:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:14:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:14:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:14:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:14:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:14:25 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:14:25 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:14:25 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 04 06:14:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.292s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:14:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:14:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:14:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:14:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:14:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b4fcacce-658e-47f5-8014-bb2db9621330 req-188ec12e-30b6-42d8-9578-1d9cf15bc945 tempest-TestStampPattern-1913670803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:14:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b4fcacce-658e-47f5-8014-bb2db9621330 req-188ec12e-30b6-42d8-9578-1d9cf15bc945 tempest-TestStampPattern-1913670803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:14:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b4fcacce-658e-47f5-8014-bb2db9621330 req-188ec12e-30b6-42d8-9578-1d9cf15bc945 tempest-TestStampPattern-1913670803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:14:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b4fcacce-658e-47f5-8014-bb2db9621330 req-188ec12e-30b6-42d8-9578-1d9cf15bc945 tempest-TestStampPattern-1913670803 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2', 'name': 'volume-e11e86a2-578e-4456-b538-3f7bb7e9b496', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca92cd57-e9de-48bf-9802-501be6b7d998', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 06:14:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-b4fcacce-658e-47f5-8014-bb2db9621330 req-188ec12e-30b6-42d8-9578-1d9cf15bc945 tempest-TestStampPattern-1913670803 None] attachment_update completed successfully. Sep 04 06:14:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-d3dae1b6-954e-402e-a104-aa425aa162c1 req-2624aa61-d7be-4e45-9d99-ded1409ce685 tempest-TestStampPattern-1913670803 None] Terminate volume connection completed successfully. Sep 04 06:14:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-d3dae1b6-954e-402e-a104-aa425aa162c1 req-2624aa61-d7be-4e45-9d99-ded1409ce685 tempest-TestStampPattern-1913670803 None] Deleting attachment ca92cd57-e9de-48bf-9802-501be6b7d998. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 06:15:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Acquiring lock "cinder-e11e86a2-578e-4456-b538-3f7bb7e9b496-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Lock "cinder-e11e86a2-578e-4456-b538-3f7bb7e9b496-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Acquiring lock "cinder-quobyte-e11e86a2-578e-4456-b538-3f7bb7e9b496" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Lock "cinder-quobyte-e11e86a2-578e-4456-b538-3f7bb7e9b496" acquired by "delete_volume" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7e1190-f049-4a72-a537-7b4995aada30]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:00 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496 Sep 04 06:15:00 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:00 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:00 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496 Sep 04 06:15:00 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:01 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e11e86a2-578e-4456-b538-3f7bb7e9b496" returned: 0 in 0.250s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Lock "cinder-quobyte-e11e86a2-578e-4456-b538-3f7bb7e9b496" released by "delete_volume" :: held 0.641s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Created reservations ['40c52581-c2ac-4c1b-af8d-b0dacaaeb9b6', '2edd0716-ebd2-4b8a-aaa6-3b174296c5a8', 'ffb27098-1117-47a8-b63b-ce434952fcb4', '434971bc-6f63-431c-afc1-eb7e225c31a3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:01 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:01 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:01 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.235s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Deleted volume successfully. Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-76ff7411-568b-4a0c-b00e-1dcc3b590c6c tempest-TestStampPattern-1913670803 None] Lock "cinder-e11e86a2-578e-4456-b538-3f7bb7e9b496-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Acquiring lock "cinder-25c73df9-d9ad-44cc-b304-39f3e77df852-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Lock "cinder-25c73df9-d9ad-44cc-b304-39f3e77df852-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Acquiring lock "cinder-quobyte-ecb325b3-7d8c-42c9-b21f-c6784de5c82c" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Lock "cinder-quobyte-ecb325b3-7d8c-42c9-b21f-c6784de5c82c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Acquiring lock "cinder-quobyte-25c73df9-d9ad-44cc-b304-39f3e77df852" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Lock "cinder-quobyte-25c73df9-d9ad-44cc-b304-39f3e77df852" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Deleting offline snapshot 25c73df9-d9ad-44cc-b304-39f3e77df852 of volume ecb325b3-7d8c-42c9-b21f-c6784de5c82c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] snapshot_file for this snap is: volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d826e0c5-00e0-431d-88ac-c21ffdab83b0]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:02 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 Sep 04 06:15:02 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:02 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd19374-33ee-4cef-b3be-b03e29ef9e15]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:02 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c Sep 04 06:15:02 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:02 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c" returned: 0 in 0.492s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:02 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 Sep 04 06:15:02 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:03 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852" returned: 0 in 0.328s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:03 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852 Sep 04 06:15:03 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:03 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c.25c73df9-d9ad-44cc-b304-39f3e77df852" returned: 0 in 0.232s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Lock "cinder-quobyte-25c73df9-d9ad-44cc-b304-39f3e77df852" released by "_delete_snapshot" :: held 1.499s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Lock "cinder-quobyte-ecb325b3-7d8c-42c9-b21f-c6784de5c82c" released by "delete_snapshot" :: held 1.525s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:03 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Created reservations ['b4ce7813-dd78-4b9c-8dbf-9ec97029a0ee', '84154163-ca0a-45a2-81f8-1120af239ba8', '6d274392-824d-4e10-9f32-0fa871efbf90', '67a50fc8-0e0e-4445-aada-9ea67db0f10d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Delete snapshot completed successfully. Sep 04 06:15:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8596bd36-f6b4-47b6-9b4f-6bcf7ac70d5a tempest-TestStampPattern-1913670803 None] Lock "cinder-25c73df9-d9ad-44cc-b304-39f3e77df852-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Acquiring lock "cinder-ecb325b3-7d8c-42c9-b21f-c6784de5c82c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Lock "cinder-ecb325b3-7d8c-42c9-b21f-c6784de5c82c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Acquiring lock "cinder-quobyte-ecb325b3-7d8c-42c9-b21f-c6784de5c82c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Lock "cinder-quobyte-ecb325b3-7d8c-42c9-b21f-c6784de5c82c" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbd8cfe-b08e-49ef-867f-5ccf46997fec]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:07 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c Sep 04 06:15:07 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:07 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:07 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c Sep 04 06:15:07 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:08 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ecb325b3-7d8c-42c9-b21f-c6784de5c82c" returned: 0 in 0.230s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Lock "cinder-quobyte-ecb325b3-7d8c-42c9-b21f-c6784de5c82c" released by "delete_volume" :: held 0.623s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:08 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Created reservations ['53da2d92-cecb-4786-8ddd-60c30a37ae0f', '9e533fa6-805f-4704-9c08-e976222bfec5', 'a4cd6ab3-f1d0-4c21-a80f-b954261a7759', 'd50b1980-361e-430a-a070-dcd0be050bb3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:08 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:08 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:08 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.223s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Deleted volume successfully. Sep 04 06:15:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-68c6014f-e8ae-479d-9446-08aa2fe4a08e tempest-TestStampPattern-1913670803 None] Lock "cinder-ecb325b3-7d8c-42c9-b21f-c6784de5c82c-delete_volume" released by "delete_volume" :: held 1.025s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:18 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:INSERT=6 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:15:18 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=22,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Flow 'volume_create_manager' (e95233e7-3904-47ca-b020-39ff0b6a98e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64ac427-9d2e-47c5-a9b9-094f0f3458df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64ac427-9d2e-47c5-a9b9-094f0f3458df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-101859196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad47f6f5-4535-4340-b06b-54fbeed40ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3636b0b577e3459abbf22a1441306e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:21Z,use_quota=True,user_id='14134bcf0c274aeb861d62e035aa5636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37409d16-3789-49ee-adbc-a4ea52bd22e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37409d16-3789-49ee-adbc-a4ea52bd22e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358ca52a-a43d-4a65-8a1b-62735481f0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358ca52a-a43d-4a65-8a1b-62735481f0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad47f6f5-4535-4340-b06b-54fbeed40ede', 'volume_name': 'volume-ad47f6f5-4535-4340-b06b-54fbeed40ede', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5810988a-f005-44eb-804b-2c71eed8e18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5810988a-f005-44eb-804b-2c71eed8e18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9387d66a-668d-4733-b45b-99541198f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Volume ad47f6f5-4535-4340-b06b-54fbeed40ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad47f6f5-4535-4340-b06b-54fbeed40ede', 'volume_size': 1} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-101859196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad47f6f5-4535-4340-b06b-54fbeed40ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3636b0b577e3459abbf22a1441306e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:21Z,use_quota=True,user_id='14134bcf0c274aeb861d62e035aa5636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Creating volume ad47f6f5-4535-4340-b06b-54fbeed40ede {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:20 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad47f6f5-4535-4340-b06b-54fbeed40ede 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:20 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad47f6f5-4535-4340-b06b-54fbeed40ede 1073741824 Sep 04 06:15:20 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:21 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad47f6f5-4535-4340-b06b-54fbeed40ede 1073741824" returned: 0 in 0.403s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad47f6f5-4535-4340-b06b-54fbeed40ede {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:21 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad47f6f5-4535-4340-b06b-54fbeed40ede Sep 04 06:15:21 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:21 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad47f6f5-4535-4340-b06b-54fbeed40ede" returned: 0 in 0.232s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9387d66a-668d-4733-b45b-99541198f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad47f6f5-4535-4340-b06b-54fbeed40ede', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0aed0a0-ea7d-4552-a17e-08637fec8264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Volume volume-ad47f6f5-4535-4340-b06b-54fbeed40ede (ad47f6f5-4535-4340-b06b-54fbeed40ede): created successfully Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0aed0a0-ea7d-4552-a17e-08637fec8264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Flow 'volume_create_manager' (e95233e7-3904-47ca-b020-39ff0b6a98e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-66df8c48-199f-4ca5-bcd4-4a5162e1de91 tempest-ProjectReaderTests-65507717 None] Created volume successfully. Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Acquiring lock "cinder-ad47f6f5-4535-4340-b06b-54fbeed40ede-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Lock "cinder-ad47f6f5-4535-4340-b06b-54fbeed40ede-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Acquiring lock "cinder-quobyte-ad47f6f5-4535-4340-b06b-54fbeed40ede" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Lock "cinder-quobyte-ad47f6f5-4535-4340-b06b-54fbeed40ede" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7d2d02-9d40-4ca3-b397-a53715d20519]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad47f6f5-4535-4340-b06b-54fbeed40ede {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:22 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad47f6f5-4535-4340-b06b-54fbeed40ede Sep 04 06:15:22 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:22 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad47f6f5-4535-4340-b06b-54fbeed40ede" returned: 0 in 0.366s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad47f6f5-4535-4340-b06b-54fbeed40ede {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:22 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad47f6f5-4535-4340-b06b-54fbeed40ede Sep 04 06:15:22 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:22 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ad47f6f5-4535-4340-b06b-54fbeed40ede" returned: 0 in 0.243s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Lock "cinder-quobyte-ad47f6f5-4535-4340-b06b-54fbeed40ede" released by "delete_volume" :: held 0.647s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Created reservations ['16741aad-cda9-4ead-9faa-3114f01c3e97', '25d27487-f2e1-4b55-a21b-4be6eebb9740', 'ff6c176a-ec83-4a92-901f-d6ec95845aaf', '7fd112c8-0819-4605-8133-dba3dfa84193'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:22 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:22 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:22 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Deleted volume successfully. Sep 04 06:15:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4df6c372-44d2-4611-9d8f-e1420ec736a4 tempest-ProjectReaderTests-65507717 None] Lock "cinder-ad47f6f5-4535-4340-b06b-54fbeed40ede-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Flow 'volume_create_manager' (46471159-f8b7-4fd0-94b0-b24f4708a6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66224a93-65d2-4ffb-bb41-ea00fda617f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66224a93-65d2-4ffb-bb41-ea00fda617f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-360757172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2bdd9da-3ff9-4fca-b213-9cee6fa293ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3636b0b577e3459abbf22a1441306e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:23Z,use_quota=True,user_id='14134bcf0c274aeb861d62e035aa5636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948a70b0-9bd2-45fb-b729-4c7e891cd69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948a70b0-9bd2-45fb-b729-4c7e891cd69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb530420-f1eb-4f24-b377-1493ffb35a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb530420-f1eb-4f24-b377-1493ffb35a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2bdd9da-3ff9-4fca-b213-9cee6fa293ac', 'volume_name': 'volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c7d011-d9da-4fa9-9130-4e872f8df802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c7d011-d9da-4fa9-9130-4e872f8df802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9437654f-5294-40a4-929c-99302b60359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Volume a2bdd9da-3ff9-4fca-b213-9cee6fa293ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac', 'volume_size': 1} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-360757172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2bdd9da-3ff9-4fca-b213-9cee6fa293ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3636b0b577e3459abbf22a1441306e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:23Z,use_quota=True,user_id='14134bcf0c274aeb861d62e035aa5636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Creating volume a2bdd9da-3ff9-4fca-b213-9cee6fa293ac {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:23 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:23 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac 1073741824 Sep 04 06:15:23 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:23 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac 1073741824" returned: 0 in 0.433s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:24 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac Sep 04 06:15:24 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:24 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9437654f-5294-40a4-929c-99302b60359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38f50e4-c3d7-46e3-9477-8ca07256a27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Volume volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac (a2bdd9da-3ff9-4fca-b213-9cee6fa293ac): created successfully Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38f50e4-c3d7-46e3-9477-8ca07256a27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Flow 'volume_create_manager' (46471159-f8b7-4fd0-94b0-b24f4708a6e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0909c52f-6ca2-4bad-9032-5cab08944478 tempest-ProjectReaderTests-65507717 None] Created volume successfully. Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Acquiring lock "cinder-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Lock "cinder-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Acquiring lock "cinder-quobyte-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Lock "cinder-quobyte-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[717dc694-c0bc-489c-a686-28803f05ad9c]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:24 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac Sep 04 06:15:24 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:24 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac" returned: 0 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:24 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac Sep 04 06:15:24 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:25 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac" returned: 0 in 0.235s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Lock "cinder-quobyte-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac" released by "delete_volume" :: held 0.620s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Created reservations ['9d49fd37-3ebb-446d-a9c4-9f43de3824f6', '208acf47-103f-4690-86c0-f908b60bb462', 'cf6724c5-bcfe-496e-8ff0-578dd9c26fb9', '4e8bdd31-d89f-4345-a28e-30ebc873e069'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:25 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:25 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:25 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:25 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:25 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.237s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:15:25 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Deleted volume successfully. Sep 04 06:15:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d93aa19c-444b-4882-93d2-850b6128af86 tempest-ProjectReaderTests-65507717 None] Lock "cinder-a2bdd9da-3ff9-4fca-b213-9cee6fa293ac-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Flow 'volume_create_manager' (31b60360-c970-4072-9673-743f79215c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93cc3af4-462c-470b-b60d-0af01551f045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93cc3af4-462c-470b-b60d-0af01551f045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242451891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2fe612-f5a6-45b3-b48b-9cb1b231d668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3636b0b577e3459abbf22a1441306e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:26Z,use_quota=True,user_id='14134bcf0c274aeb861d62e035aa5636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58949a55-7807-4337-81e3-108c168e3445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58949a55-7807-4337-81e3-108c168e3445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f38b6ef-d3b1-4bd6-bcac-0ff84c5f476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f38b6ef-d3b1-4bd6-bcac-0ff84c5f476a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a2fe612-f5a6-45b3-b48b-9cb1b231d668', 'volume_name': 'volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87890c1e-bce3-4e33-a231-7507a1b54cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87890c1e-bce3-4e33-a231-7507a1b54cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0a1649-dd92-432f-9b41-eb47d81ac5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Volume 1a2fe612-f5a6-45b3-b48b-9cb1b231d668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668', 'volume_size': 1} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242451891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2fe612-f5a6-45b3-b48b-9cb1b231d668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3636b0b577e3459abbf22a1441306e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:26Z,use_quota=True,user_id='14134bcf0c274aeb861d62e035aa5636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Creating volume 1a2fe612-f5a6-45b3-b48b-9cb1b231d668 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:26 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:26 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668 1073741824 Sep 04 06:15:26 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:26 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668 1073741824" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:26 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668 Sep 04 06:15:26 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:26 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668" returned: 0 in 0.235s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0a1649-dd92-432f-9b41-eb47d81ac5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc60f320-0881-4aab-a003-3b289529df7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Volume volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668 (1a2fe612-f5a6-45b3-b48b-9cb1b231d668): created successfully Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc60f320-0881-4aab-a003-3b289529df7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Flow 'volume_create_manager' (31b60360-c970-4072-9673-743f79215c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c72f859c-a092-4bbe-ae20-e8aac3d2561d tempest-ProjectReaderTests-65507717 None] Created volume successfully. Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Acquiring lock "cinder-1a2fe612-f5a6-45b3-b48b-9cb1b231d668-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Lock "cinder-1a2fe612-f5a6-45b3-b48b-9cb1b231d668-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Acquiring lock "cinder-quobyte-1a2fe612-f5a6-45b3-b48b-9cb1b231d668" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Lock "cinder-quobyte-1a2fe612-f5a6-45b3-b48b-9cb1b231d668" acquired by "delete_volume" :: waited 0.012s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3184bef7-ca9d-4405-9a0f-fdeb29150175]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:27 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668 Sep 04 06:15:27 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:27 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:27 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668 Sep 04 06:15:27 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:27 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-1a2fe612-f5a6-45b3-b48b-9cb1b231d668" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Lock "cinder-quobyte-1a2fe612-f5a6-45b3-b48b-9cb1b231d668" released by "delete_volume" :: held 0.637s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Created reservations ['c7a07a57-7943-474d-beff-c0d516ac3e61', '99470e44-4a7a-4442-88e3-f045fe1826ef', 'a96eaa74-88eb-40c2-a372-34d79c60626d', '8ab25bbc-0706-43b6-a7d2-eb98114d3dce'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:27 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:27 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:28 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.261s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Deleted volume successfully. Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fbda95e2-e6e7-4c05-b726-ab3315d932ce tempest-ProjectReaderTests-65507717 None] Lock "cinder-1a2fe612-f5a6-45b3-b48b-9cb1b231d668-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Flow 'volume_create_manager' (48724b44-f397-47f9-b161-849e68c912e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b3e79f-622e-4202-9ab4-3d3910774e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b3e79f-622e-4202-9ab4-3d3910774e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172504673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3636b0b577e3459abbf22a1441306e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:29Z,use_quota=True,user_id='14134bcf0c274aeb861d62e035aa5636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d815ad7d-4c8c-4a63-ac43-2c2cb66c9f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d815ad7d-4c8c-4a63-ac43-2c2cb66c9f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10dae8b1-c7be-4ca8-b21a-e3ef91099290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10dae8b1-c7be-4ca8-b21a-e3ef91099290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e', 'volume_name': 'volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558860e7-0a46-49a2-badc-e84ab81eb59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558860e7-0a46-49a2-badc-e84ab81eb59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f547ad-f263-47be-805a-bae4bc9a9ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Volume 3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e', 'volume_size': 1} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172504673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3636b0b577e3459abbf22a1441306e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:29Z,use_quota=True,user_id='14134bcf0c274aeb861d62e035aa5636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Creating volume 3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:28 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:28 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e 1073741824 Sep 04 06:15:28 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:29 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e 1073741824" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:29 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e Sep 04 06:15:29 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:29 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e" returned: 0 in 0.233s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f547ad-f263-47be-805a-bae4bc9a9ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4902ad81-3e27-4eed-bee8-c9ed0a227402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Volume volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e (3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e): created successfully Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4902ad81-3e27-4eed-bee8-c9ed0a227402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Flow 'volume_create_manager' (48724b44-f397-47f9-b161-849e68c912e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-15a24ec7-c83e-41ea-9ea2-281b8ff75b42 tempest-ProjectReaderTests-65507717 None] Created volume successfully. Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Acquiring lock "cinder-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Lock "cinder-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Acquiring lock "cinder-quobyte-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Lock "cinder-quobyte-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e" acquired by "delete_volume" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e0c572-03f5-4c43-bcdb-25b2e2dc367f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:29 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e Sep 04 06:15:29 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:30 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:30 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e Sep 04 06:15:30 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:30 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e" returned: 0 in 0.234s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Lock "cinder-quobyte-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e" released by "delete_volume" :: held 0.621s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Created reservations ['65e3a9aa-a85f-47f7-83b8-36acef612bb7', 'f30cce65-0cd2-468b-8390-9f66f6f33c03', '30de8a9f-2bcb-4ae1-a078-64a7a675815b', '0d8950bf-b676-40ce-bfed-5af54a611e46'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:30 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:30 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:30 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.232s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Deleted volume successfully. Sep 04 06:15:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b4c4306-f0da-41dd-a969-1c3b4851aa04 tempest-ProjectReaderTests-65507717 None] Lock "cinder-3c5d8ba5-ab9e-479e-8cc1-186c1fbc072e-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=25,cinder:UPDATE=42,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:15:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=46,cinder:SELECT=31,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Flow 'volume_create_manager' (45a7a9d5-9236-4536-8452-ce10bfd129d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5be677e-b9d7-46c4-95ef-5dd53f1815e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5be677e-b9d7-46c4-95ef-5dd53f1815e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-348930977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8da16c8e180426aae5473b0d576c216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:43Z,use_quota=True,user_id='e83a571b1a9743babd6de2e6edf41bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5a4d12-7d55-4789-89d6-db5117dee7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5a4d12-7d55-4789-89d6-db5117dee7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e66651-19ad-463b-a079-b5ea240c76ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e66651-19ad-463b-a079-b5ea240c76ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5', 'volume_name': 'volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fb9a93-7c23-49c6-a1e5-5b24baf2cfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fb9a93-7c23-49c6-a1e5-5b24baf2cfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1bdb7f-5750-4c46-93dd-ed4bcca73ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Volume b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5', 'volume_size': 1} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-348930977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8da16c8e180426aae5473b0d576c216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:43Z,use_quota=True,user_id='e83a571b1a9743babd6de2e6edf41bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Creating volume b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:43 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:43 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5 1073741824 Sep 04 06:15:43 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Flow 'volume_create_manager' (e84eaf78-f78e-40bb-a8fc-72cf207c2a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14159f8a-c683-4d6d-924e-81d6ff8be8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14159f8a-c683-4d6d-924e-81d6ff8be8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ca1c45-7d7d-4289-9c58-d56013caef4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5291df27be1a47a8ad850eb5097c3040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:43Z,use_quota=True,user_id='ac3ce0c855af44449219788dde5db536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a3df67-43ff-42cd-85f5-e21d1e4c919f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a3df67-43ff-42cd-85f5-e21d1e4c919f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812b3ba6-76f9-48a9-a032-80cbd72fc5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812b3ba6-76f9-48a9-a032-80cbd72fc5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3ca1c45-7d7d-4289-9c58-d56013caef4a', 'volume_name': 'volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c998b474-e7bf-4dd8-a8bd-be75a6d061c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c998b474-e7bf-4dd8-a8bd-be75a6d061c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3492e1c2-7e64-4a31-9f2d-cacb6c3ea029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Volume f3ca1c45-7d7d-4289-9c58-d56013caef4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a', 'volume_size': 1} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Flow 'volume_create_manager' (83236e24-e8d3-4019-b821-5751dae49b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280401b7-ef46-47c0-a546-b5ef0a6add2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280401b7-ef46-47c0-a546-b5ef0a6add2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-793770313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0760da64-9c0f-4524-b676-fa19a72df9a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8da16c8e180426aae5473b0d576c216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:44Z,use_quota=True,user_id='e83a571b1a9743babd6de2e6edf41bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f18c976-c339-4d93-ae06-edbd2a3d8c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f18c976-c339-4d93-ae06-edbd2a3d8c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471739c3-85d1-4165-a70e-862fac3ad8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471739c3-85d1-4165-a70e-862fac3ad8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0760da64-9c0f-4524-b676-fa19a72df9a5', 'volume_name': 'volume-0760da64-9c0f-4524-b676-fa19a72df9a5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f778b84b-7305-4565-9c6a-ef416091da3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f778b84b-7305-4565-9c6a-ef416091da3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d49cc4-72f4-4666-b8cc-b8a1fa6a6aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Volume 0760da64-9c0f-4524-b676-fa19a72df9a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0760da64-9c0f-4524-b676-fa19a72df9a5', 'volume_size': 1} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:44 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5 1073741824" returned: 0 in 0.713s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Flow 'volume_create_manager' (52c7409e-d8c6-48ca-958a-ff62ed6b2a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8de40f-5b9f-430f-916d-6842687797af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8de40f-5b9f-430f-916d-6842687797af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1231710825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66433e05-5ddb-46b9-90d1-701ba7bf1144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8da16c8e180426aae5473b0d576c216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:44Z,use_quota=True,user_id='e83a571b1a9743babd6de2e6edf41bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:44 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5 Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d3c8f8-ae3a-4c41-90bb-dd07549e354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d3c8f8-ae3a-4c41-90bb-dd07549e354d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285a3aae-33bb-4a00-8b72-0c6e03f2e784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285a3aae-33bb-4a00-8b72-0c6e03f2e784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66433e05-5ddb-46b9-90d1-701ba7bf1144', 'volume_name': 'volume-66433e05-5ddb-46b9-90d1-701ba7bf1144', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3209b7-9dd7-4d35-b0eb-499e893bf742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3209b7-9dd7-4d35-b0eb-499e893bf742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4135ac-cffa-40dc-ae2c-a553b68ee049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Volume 66433e05-5ddb-46b9-90d1-701ba7bf1144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66433e05-5ddb-46b9-90d1-701ba7bf1144', 'volume_size': 1} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Flow 'volume_create_manager' (083b2576-0652-47b9-b887-95574ee285f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e36681-ec45-473a-a90d-a9f13247419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e36681-ec45-473a-a90d-a9f13247419b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-938910393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e666234-1410-40aa-9c02-a43775f7d6ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8da16c8e180426aae5473b0d576c216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:45Z,use_quota=True,user_id='e83a571b1a9743babd6de2e6edf41bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbe0657-48ea-48a4-af09-c15be949b18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbe0657-48ea-48a4-af09-c15be949b18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3bb6d8-4073-4dc0-a586-6aa2c2bf03af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3bb6d8-4073-4dc0-a586-6aa2c2bf03af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e666234-1410-40aa-9c02-a43775f7d6ff', 'volume_name': 'volume-4e666234-1410-40aa-9c02-a43775f7d6ff', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d448d2-dae0-4282-b547-ef28be2e1075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d448d2-dae0-4282-b547-ef28be2e1075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c827763-31fd-4a92-ba9d-de8eac9c34df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Volume 4e666234-1410-40aa-9c02-a43775f7d6ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e666234-1410-40aa-9c02-a43775f7d6ff', 'volume_size': 1} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5" returned: 0 in 0.482s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.983s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ca1c45-7d7d-4289-9c58-d56013caef4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5291df27be1a47a8ad850eb5097c3040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:43Z,use_quota=True,user_id='ac3ce0c855af44449219788dde5db536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Creating volume f3ca1c45-7d7d-4289-9c58-d56013caef4a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:44 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1bdb7f-5750-4c46-93dd-ed4bcca73ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:44 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a 1073741824 Sep 04 06:15:44 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac80d05-460e-4175-bc12-e72526a69971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Volume volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5 (b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5): created successfully Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac80d05-460e-4175-bc12-e72526a69971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Flow 'volume_create_manager' (45a7a9d5-9236-4536-8452-ce10bfd129d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-37b69e4f-40ae-4d67-910c-ae784c535763 tempest-CreateVolumesFromImageTest-1969670162 None] Created volume successfully. Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Flow 'volume_create_manager' (0bcc40bd-cb57-4905-bbf3-09479bdf9ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea8ee1e-0f9c-4b94-9c0c-7f1d20810c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea8ee1e-0f9c-4b94-9c0c-7f1d20810c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1241681618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13a89cc-35f5-4de2-802b-69c13924563d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8da16c8e180426aae5473b0d576c216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:45Z,use_quota=True,user_id='e83a571b1a9743babd6de2e6edf41bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab293e0b-ab3c-4f71-af8c-0e53611757bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab293e0b-ab3c-4f71-af8c-0e53611757bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b39ced-2074-460e-8312-c7c9ef924acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b39ced-2074-460e-8312-c7c9ef924acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b13a89cc-35f5-4de2-802b-69c13924563d', 'volume_name': 'volume-b13a89cc-35f5-4de2-802b-69c13924563d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e0d640-0166-4599-8052-03749d80493b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e0d640-0166-4599-8052-03749d80493b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7fb34e-801b-4247-b353-88bcd8b9a7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Volume b13a89cc-35f5-4de2-802b-69c13924563d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b13a89cc-35f5-4de2-802b-69c13924563d', 'volume_size': 1} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:45 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a 1073741824" returned: 0 in 0.628s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:45 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a Sep 04 06:15:45 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:45 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a" returned: 0 in 0.272s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-793770313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0760da64-9c0f-4524-b676-fa19a72df9a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8da16c8e180426aae5473b0d576c216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:44Z,use_quota=True,user_id='e83a571b1a9743babd6de2e6edf41bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Creating volume 0760da64-9c0f-4524-b676-fa19a72df9a5 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:45 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0760da64-9c0f-4524-b676-fa19a72df9a5 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3492e1c2-7e64-4a31-9f2d-cacb6c3ea029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f22efc6-6c26-4330-98df-f23da20fa175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:45 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0760da64-9c0f-4524-b676-fa19a72df9a5 1073741824 Sep 04 06:15:45 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Volume volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a (f3ca1c45-7d7d-4289-9c58-d56013caef4a): created successfully Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f22efc6-6c26-4330-98df-f23da20fa175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Flow 'volume_create_manager' (e84eaf78-f78e-40bb-a8fc-72cf207c2a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-26c9bc67-e776-4e22-9b40-f56ffff21773 tempest-CinderUnicodeTest-127673988 None] Created volume successfully. Sep 04 06:15:46 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0760da64-9c0f-4524-b676-fa19a72df9a5 1073741824" returned: 0 in 0.561s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0760da64-9c0f-4524-b676-fa19a72df9a5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:46 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0760da64-9c0f-4524-b676-fa19a72df9a5 Sep 04 06:15:46 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Flow 'volume_create_manager' (0706f439-c68a-445e-bfc3-86e6030b1568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4b2d38-bc67-4a83-af31-4f8016353aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:46 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0760da64-9c0f-4524-b676-fa19a72df9a5" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.267s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1231710825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66433e05-5ddb-46b9-90d1-701ba7bf1144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8da16c8e180426aae5473b0d576c216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:44Z,use_quota=True,user_id='e83a571b1a9743babd6de2e6edf41bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Creating volume 66433e05-5ddb-46b9-90d1-701ba7bf1144 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:46 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66433e05-5ddb-46b9-90d1-701ba7bf1144 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4b2d38-bc67-4a83-af31-4f8016353aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3208d9f1-44d8-41d3-b2eb-c9bed9679fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98194a8dba204f4a80363b3faf17c396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:47Z,use_quota=True,user_id='3a674685a7fd4af8bf17f9495fed82b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316c9445-f15b-48b7-ac64-8504e8a5cf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:46 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66433e05-5ddb-46b9-90d1-701ba7bf1144 1073741824 Sep 04 06:15:46 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316c9445-f15b-48b7-ac64-8504e8a5cf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a330d867-6913-4275-94ef-8d18c705da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d49cc4-72f4-4666-b8cc-b8a1fa6a6aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0760da64-9c0f-4524-b676-fa19a72df9a5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdd0527-91a8-4af7-9e9a-b7ee983a5fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:46 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Volume volume-0760da64-9c0f-4524-b676-fa19a72df9a5 (0760da64-9c0f-4524-b676-fa19a72df9a5): created successfully Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdd0527-91a8-4af7-9e9a-b7ee983a5fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Flow 'volume_create_manager' (83236e24-e8d3-4019-b821-5751dae49b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e092bf73-7086-4aa4-bfcf-b90f86628171 tempest-CreateVolumesFromImageTest-1969670162 None] Created volume successfully. Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Flow 'volume_create_manager' (a7d1e954-4bed-4c6f-89fc-c9b9d2d2ebee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e4bafa-cb0f-4b6c-af6d-038c80a25b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e4bafa-cb0f-4b6c-af6d-038c80a25b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1699309105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873286e2-7bf1-4007-8894-2fd234a8f16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5291df27be1a47a8ad850eb5097c3040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:47Z,use_quota=True,user_id='ac3ce0c855af44449219788dde5db536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d168c8-e95c-40ef-862f-9ebc37f391d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d168c8-e95c-40ef-862f-9ebc37f391d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c2ba2e-c305-4b56-aad4-5b886236a749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c2ba2e-c305-4b56-aad4-5b886236a749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '873286e2-7bf1-4007-8894-2fd234a8f16d', 'volume_name': 'volume-873286e2-7bf1-4007-8894-2fd234a8f16d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0081ce9-0726-4ac6-9f28-8babeff24605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0081ce9-0726-4ac6-9f28-8babeff24605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525170d7-5839-4207-91a6-5c402171382e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Volume 873286e2-7bf1-4007-8894-2fd234a8f16d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-873286e2-7bf1-4007-8894-2fd234a8f16d', 'volume_size': 1} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a330d867-6913-4275-94ef-8d18c705da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3208d9f1-44d8-41d3-b2eb-c9bed9679fa2', 'volume_name': 'volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2', 'volume_size': 1, 'image_id': '2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce93a5d5083db117b70146a9ca6e478a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98194a8dba204f4a80363b3faf17c396', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fcfa4de53a7231e602e14e66f5cc888b6da331f695a549ee9caee639c3c87b8a3286f347f757a316077151aa0783ee2a611be86a2bacfe30eba3d2fbcd6a122d', 'id': '2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'created_at': datetime.datetime(2026, 9, 4, 4, 15, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 15, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24fe91f-4455-47e7-8528-048098c8e22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24fe91f-4455-47e7-8528-048098c8e22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b1c18c-bd95-4d58-9dc1-8b4cae5e2e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Volume 3208d9f1-44d8-41d3-b2eb-c9bed9679fa2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2', 'volume_size': 1, 'image_id': '2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce93a5d5083db117b70146a9ca6e478a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98194a8dba204f4a80363b3faf17c396', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fcfa4de53a7231e602e14e66f5cc888b6da331f695a549ee9caee639c3c87b8a3286f347f757a316077151aa0783ee2a611be86a2bacfe30eba3d2fbcd6a122d', 'id': '2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'created_at': datetime.datetime(2026, 9, 4, 4, 15, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 15, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0/file', 'properties': {}}, 'image_service': } Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Trying to clone 3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 from image 2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 06:15:47 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66433e05-5ddb-46b9-90d1-701ba7bf1144 1073741824" returned: 0 in 0.620s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 06:15:47 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Image download 0.00 MB at 0.00 MB/s Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66433e05-5ddb-46b9-90d1-701ba7bf1144 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:47 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66433e05-5ddb-46b9-90d1-701ba7bf1144 Sep 04 06:15:47 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e397504b-8e41-4f44-b223-95c22abb14af]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:47 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD Sep 04 06:15:47 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:47 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66433e05-5ddb-46b9-90d1-701ba7bf1144" returned: 0 in 0.299s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.888s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-938910393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e666234-1410-40aa-9c02-a43775f7d6ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8da16c8e180426aae5473b0d576c216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:45Z,use_quota=True,user_id='e83a571b1a9743babd6de2e6edf41bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Creating volume 4e666234-1410-40aa-9c02-a43775f7d6ff {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:47 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4e666234-1410-40aa-9c02-a43775f7d6ff 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:47 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4e666234-1410-40aa-9c02-a43775f7d6ff 1073741824 Sep 04 06:15:47 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4135ac-cffa-40dc-ae2c-a553b68ee049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66433e05-5ddb-46b9-90d1-701ba7bf1144', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2e5a59-7049-4d6b-ad51-7dc1b688c896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Volume volume-66433e05-5ddb-46b9-90d1-701ba7bf1144 (66433e05-5ddb-46b9-90d1-701ba7bf1144): created successfully Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2e5a59-7049-4d6b-ad51-7dc1b688c896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Flow 'volume_create_manager' (52c7409e-d8c6-48ca-958a-ff62ed6b2a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0a30df1b-dbd5-4894-8b6f-e1ef3c1bb5fb tempest-CreateVolumesFromImageTest-1969670162 None] Created volume successfully. Sep 04 06:15:47 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Flow 'volume_create_manager' (8c1a9abc-7d7d-4f7c-a146-218623c4f831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b73e00-a291-4c06-8200-54e1f01fdb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b73e00-a291-4c06-8200-54e1f01fdb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3316f7-1ac3-4877-9701-9110b64531dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286a1942dc224dd1b121d4c9778fcf39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:48Z,use_quota=True,user_id='293a786351a04c8990d673e4f89e6d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7360e0d0-7ad0-41de-9cf6-5d0b617d2dd8),volume_type_id=7360e0d0-7ad0-41de-9cf6-5d0b617d2dd8)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d445c35c-15a9-48d5-9647-1f633ef75f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d445c35c-15a9-48d5-9647-1f633ef75f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18049ec3-e7eb-46df-8c54-dd6d4e55f9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 06:15:48 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD Sep 04 06:15:48 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18049ec3-e7eb-46df-8c54-dd6d4e55f9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b3316f7-1ac3-4877-9701-9110b64531dd', 'volume_name': 'volume-3b3316f7-1ac3-4877-9701-9110b64531dd', 'volume_size': 1, 'image_id': '40fba0eb-28c2-4d58-9f8c-1729d984d248', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40fba0eb-28c2-4d58-9f8c-1729d984d248', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '403d116271ea6dba985374250f7f99fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '286a1942dc224dd1b121d4c9778fcf39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ec4c92f5c1ada3fe273bb1023a140eabba17d3a3e7ca33938dfe7186746010519d231961182a594fc94977306af7e2a9664380df8582d5d811691a073974c65', 'id': '40fba0eb-28c2-4d58-9f8c-1729d984d248', 'created_at': datetime.datetime(2026, 9, 4, 4, 15, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 15, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40fba0eb-28c2-4d58-9f8c-1729d984d248/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5320ba7b-e4a0-4224-824b-ae1b175e0d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:48 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5320ba7b-e4a0-4224-824b-ae1b175e0d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e927df-e2b2-4fb4-823e-d17ca9702dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Volume 3b3316f7-1ac3-4877-9701-9110b64531dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b3316f7-1ac3-4877-9701-9110b64531dd', 'volume_size': 1, 'image_id': '40fba0eb-28c2-4d58-9f8c-1729d984d248', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40fba0eb-28c2-4d58-9f8c-1729d984d248', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '403d116271ea6dba985374250f7f99fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '286a1942dc224dd1b121d4c9778fcf39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ec4c92f5c1ada3fe273bb1023a140eabba17d3a3e7ca33938dfe7186746010519d231961182a594fc94977306af7e2a9664380df8582d5d811691a073974c65', 'id': '40fba0eb-28c2-4d58-9f8c-1729d984d248', 'created_at': datetime.datetime(2026, 9, 4, 4, 15, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 15, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40fba0eb-28c2-4d58-9f8c-1729d984d248/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Trying to clone 3b3316f7-1ac3-4877-9701-9110b64531dd from image 40fba0eb-28c2-4d58-9f8c-1729d984d248 at location (None, [{'url': 'file:///opt/stack/data/glance/images/40fba0eb-28c2-4d58-9f8c-1729d984d248', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4e666234-1410-40aa-9c02-a43775f7d6ff 1073741824" returned: 0 in 0.620s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:48 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD" returned: 1 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Temporary image 2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0 is fetched for user 3a674685a7fd4af8bf17f9495fed82b8. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4e666234-1410-40aa-9c02-a43775f7d6ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:48 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4e666234-1410-40aa-9c02-a43775f7d6ff Sep 04 06:15:48 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[55620cb8-4394-425e-b8f9-3c49bd53e871]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 06:15:48 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Image download 0.00 MB at 0.00 MB/s Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3c3925-2fdf-4bb6-8ce2-b0b178bd858c]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:48 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD Sep 04 06:15:48 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:48 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD Sep 04 06:15:48 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:48 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4e666234-1410-40aa-9c02-a43775f7d6ff" returned: 0 in 0.268s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.310s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1241681618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13a89cc-35f5-4de2-802b-69c13924563d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8da16c8e180426aae5473b0d576c216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:45Z,use_quota=True,user_id='e83a571b1a9743babd6de2e6edf41bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Creating volume b13a89cc-35f5-4de2-802b-69c13924563d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:48 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89cc-35f5-4de2-802b-69c13924563d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:48 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89cc-35f5-4de2-802b-69c13924563d 1073741824 Sep 04 06:15:48 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c827763-31fd-4a92-ba9d-de8eac9c34df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e666234-1410-40aa-9c02-a43775f7d6ff', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e475c8d1-1015-4aac-9a2c-67cebc2d1c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Volume volume-4e666234-1410-40aa-9c02-a43775f7d6ff (4e666234-1410-40aa-9c02-a43775f7d6ff): created successfully Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e475c8d1-1015-4aac-9a2c-67cebc2d1c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Flow 'volume_create_manager' (083b2576-0652-47b9-b887-95574ee285f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8e614fec-7839-4d54-ab08-ad8d2803e0e1 tempest-CreateVolumesFromImageTest-1969670162 None] Created volume successfully. Sep 04 06:15:48 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:48 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:48 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD Sep 04 06:15:48 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:49 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD Sep 04 06:15:49 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:49 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89cc-35f5-4de2-802b-69c13924563d 1073741824" returned: 0 in 0.452s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89cc-35f5-4de2-802b-69c13924563d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:49 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89cc-35f5-4de2-802b-69c13924563d Sep 04 06:15:49 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:49 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:49 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Temporary image 40fba0eb-28c2-4d58-9f8c-1729d984d248 is fetched for user 293a786351a04c8990d673e4f89e6d9a. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ea102c-9aab-4f23-b73e-6373292e877f]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:49 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD Sep 04 06:15:49 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:49 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89cc-35f5-4de2-802b-69c13924563d" returned: 0 in 0.257s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.210s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1699309105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873286e2-7bf1-4007-8894-2fd234a8f16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5291df27be1a47a8ad850eb5097c3040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:47Z,use_quota=True,user_id='ac3ce0c855af44449219788dde5db536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Creating volume 873286e2-7bf1-4007-8894-2fd234a8f16d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:49 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7fb34e-801b-4247-b353-88bcd8b9a7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13a89cc-35f5-4de2-802b-69c13924563d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:49 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d 1073741824 Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10693328-8aa9-49e1-b159-dab770e0b1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:49 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:49 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Volume volume-b13a89cc-35f5-4de2-802b-69c13924563d (b13a89cc-35f5-4de2-802b-69c13924563d): created successfully Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10693328-8aa9-49e1-b159-dab770e0b1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Flow 'volume_create_manager' (0bcc40bd-cb57-4905-bbf3-09479bdf9ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-40fb7159-cf69-4f66-a23e-28bbf98d90e6 tempest-CreateVolumesFromImageTest-1969670162 None] Created volume successfully. Sep 04 06:15:49 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "cinder-b13a89cc-35f5-4de2-802b-69c13924563d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-b13a89cc-35f5-4de2-802b-69c13924563d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "cinder-quobyte-b13a89cc-35f5-4de2-802b-69c13924563d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-quobyte-b13a89cc-35f5-4de2-802b-69c13924563d" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:49 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD Sep 04 06:15:49 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[12836d67-4439-4da6-8c30-7ce33ad0b67d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89cc-35f5-4de2-802b-69c13924563d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:49 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89cc-35f5-4de2-802b-69c13924563d Sep 04 06:15:49 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:49 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d 1073741824" returned: 0 in 0.499s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:50 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d Sep 04 06:15:50 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:50 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:50 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89cc-35f5-4de2-802b-69c13924563d" returned: 0 in 0.394s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89cc-35f5-4de2-802b-69c13924563d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:50 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89cc-35f5-4de2-802b-69c13924563d Sep 04 06:15:50 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:50 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d" returned: 0 in 0.281s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.069s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3208d9f1-44d8-41d3-b2eb-c9bed9679fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98194a8dba204f4a80363b3faf17c396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:47Z,use_quota=True,user_id='3a674685a7fd4af8bf17f9495fed82b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Creating volume 3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:50 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525170d7-5839-4207-91a6-5c402171382e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-873286e2-7bf1-4007-8894-2fd234a8f16d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:50 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 1073741824 Sep 04 06:15:50 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c6ad3e-ff92-45ee-800c-30adf504c3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:50 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Volume volume-873286e2-7bf1-4007-8894-2fd234a8f16d (873286e2-7bf1-4007-8894-2fd234a8f16d): created successfully Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c6ad3e-ff92-45ee-800c-30adf504c3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Flow 'volume_create_manager' (a7d1e954-4bed-4c6f-89fc-c9b9d2d2ebee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3c2db70f-2091-4ceb-81fa-727ab41109e2 tempest-CinderUnicodeTest-127673988 None] Created volume successfully. Sep 04 06:15:50 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b13a89cc-35f5-4de2-802b-69c13924563d" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-quobyte-b13a89cc-35f5-4de2-802b-69c13924563d" released by "delete_volume" :: held 0.697s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Created reservations ['18af97df-c18c-4a8d-9204-344bb78b184b', 'c229a22d-2765-4441-89c0-b90a9e6ff841', '9107fb8c-9f01-4a9f-b5ab-463fd5a9e066', '17ec75fa-fe99-4ee5-803d-c922cf76c6a3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:50 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:50 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:50 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 1073741824" returned: 0 in 0.420s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:50 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 Sep 04 06:15:50 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:50 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Deleted volume successfully. Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "cinder-4e666234-1410-40aa-9c02-a43775f7d6ff-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-929d4dec-ab35-4411-a47f-093ce02f5cd3 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-b13a89cc-35f5-4de2-802b-69c13924563d-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-4e666234-1410-40aa-9c02-a43775f7d6ff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "cinder-quobyte-4e666234-1410-40aa-9c02-a43775f7d6ff" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-quobyte-4e666234-1410-40aa-9c02-a43775f7d6ff" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a309df-18cd-436e-97aa-0e6a7c35975a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4e666234-1410-40aa-9c02-a43775f7d6ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:51 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2" returned: 0 in 0.290s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.991s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3316f7-1ac3-4877-9701-9110b64531dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286a1942dc224dd1b121d4c9778fcf39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:48Z,use_quota=True,user_id='293a786351a04c8990d673e4f89e6d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7360e0d0-7ad0-41de-9cf6-5d0b617d2dd8),volume_type_id=7360e0d0-7ad0-41de-9cf6-5d0b617d2dd8)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Creating volume 3b3316f7-1ac3-4877-9701-9110b64531dd {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:15:51 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:51 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4e666234-1410-40aa-9c02-a43775f7d6ff Sep 04 06:15:51 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:51 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd 1073741824 Sep 04 06:15:51 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Attempting download of 2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'metadata': {}}])) to volume 3208d9f1-44d8-41d3-b2eb-c9bed9679fa2. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[80412f34-6420-4a2d-8d31-4205014ead32]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_yiumwg1z {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:51 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_yiumwg1z Sep 04 06:15:51 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:51 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4e666234-1410-40aa-9c02-a43775f7d6ff" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4e666234-1410-40aa-9c02-a43775f7d6ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:51 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4e666234-1410-40aa-9c02-a43775f7d6ff Sep 04 06:15:51 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:51 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd 1073741824" returned: 0 in 0.513s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:51 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_yiumwg1z" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_yiumwg1z {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:51 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-4e666234-1410-40aa-9c02-a43775f7d6ff" returned: 0 in 0.313s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:51 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd Sep 04 06:15:51 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-quobyte-4e666234-1410-40aa-9c02-a43775f7d6ff" released by "delete_volume" :: held 0.746s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:51 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_yiumwg1z Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Created reservations ['48a69c09-c7d7-4320-814a-2292d63458d9', '95a0d1a8-35bd-4574-9edf-44dbbcd115aa', 'a440e668-9547-4db0-ada0-65289ea167d6', '12972130-d904-4bd3-b548-76133db79bb2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:51 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:51 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:51 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:51 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.362s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] Creating offline snapshot 2858edaf-d0a3-47dd-981d-f755112ca6ac of volume 873286e2-7bf1-4007-8894-2fd234a8f16d {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:15:51 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_yiumwg1z" returned: 1 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_yiumwg1z' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a599d692-a3d3-4e22-8822-fccfc58b9b33]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Attempting download of 40fba0eb-28c2-4d58-9f8c-1729d984d248 ((None, [{'url': 'file:///opt/stack/data/glance/images/40fba0eb-28c2-4d58-9f8c-1729d984d248', 'metadata': {}}])) to volume 3b3316f7-1ac3-4877-9701-9110b64531dd. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[546ad097-3581-4bf1-9366-343493bca6b4]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "cinder-66433e05-5ddb-46b9-90d1-701ba7bf1144-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[43923180-6988-4f6e-ba41-06d482e17ec5]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40fba0eb-28c2-4d58-9f8c-1729d984d248__g12cgi8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:52 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.371s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-66433e05-5ddb-46b9-90d1-701ba7bf1144-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Deleted volume successfully. Sep 04 06:15:52 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD Sep 04 06:15:52 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:52 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c99983ff-eccf-4f3b-a146-9948d4dff9e3 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-4e666234-1410-40aa-9c02-a43775f7d6ff-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:52 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "cinder-quobyte-66433e05-5ddb-46b9-90d1-701ba7bf1144" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-quobyte-66433e05-5ddb-46b9-90d1-701ba7bf1144" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:52 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40fba0eb-28c2-4d58-9f8c-1729d984d248__g12cgi8 Sep 04 06:15:52 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6700214c-72dd-4a83-b210-f87e6ace59ba]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66433e05-5ddb-46b9-90d1-701ba7bf1144 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:52 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66433e05-5ddb-46b9-90d1-701ba7bf1144 Sep 04 06:15:52 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:52 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:52 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d" returned: 0 in 0.524s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:52 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40fba0eb-28c2-4d58-9f8c-1729d984d248__g12cgi8" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40fba0eb-28c2-4d58-9f8c-1729d984d248__g12cgi8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:52 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac 1G Sep 04 06:15:52 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:52 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD Sep 04 06:15:52 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:52 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40fba0eb-28c2-4d58-9f8c-1729d984d248__g12cgi8 Sep 04 06:15:52 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:52 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66433e05-5ddb-46b9-90d1-701ba7bf1144" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66433e05-5ddb-46b9-90d1-701ba7bf1144 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:52 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66433e05-5ddb-46b9-90d1-701ba7bf1144 Sep 04 06:15:52 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:52 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] 2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0 was raw, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:52 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 Sep 04 06:15:52 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:52 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac 1G" returned: 0 in 0.440s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-873286e2-7bf1-4007-8894-2fd234a8f16d -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:52 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:52 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-873286e2-7bf1-4007-8894-2fd234a8f16d -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac Sep 04 06:15:52 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40fba0eb-28c2-4d58-9f8c-1729d984d248__g12cgi8" returned: 1 in 0.439s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40fba0eb-28c2-4d58-9f8c-1729d984d248__g12cgi8' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a75016c-c595-4cac-bb0f-de07c34b21d7]: (4, 'raw') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:53 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-66433e05-5ddb-46b9-90d1-701ba7bf1144" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-quobyte-66433e05-5ddb-46b9-90d1-701ba7bf1144" released by "delete_volume" :: held 0.854s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:53 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD Sep 04 06:15:53 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Created reservations ['4f5c0eb8-6592-448f-b973-44585589c5c6', '58fc8893-6986-4bc7-9dc8-290c2837dfa9', '02d4d5a0-73af-46a2-ac77-9af3e86417b8', '11794ff0-2cad-4e7f-b633-a7aa9b1cce5a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:53 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:53 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:53 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-873286e2-7bf1-4007-8894-2fd234a8f16d -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac" returned: 0 in 0.427s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:53 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac is being set with open permissions: ugo+rw Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:53 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2" returned: 0 in 0.576s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0_r8niq6xudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:15:53 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:53 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac Sep 04 06:15:53 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:53 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 1G Sep 04 06:15:53 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "cinder-0760da64-9c0f-4524-b676-fa19a72df9a5-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-0760da64-9c0f-4524-b676-fa19a72df9a5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:53 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD" returned: 0 in 0.586s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "cinder-quobyte-0760da64-9c0f-4524-b676-fa19a72df9a5" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-quobyte-0760da64-9c0f-4524-b676-fa19a72df9a5" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8d6876-9171-437c-b9a5-853d578436e9]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0760da64-9c0f-4524-b676-fa19a72df9a5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:53 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Deleted volume successfully. Sep 04 06:15:53 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD Sep 04 06:15:53 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c1ad82f8-a7d9-4340-9a8d-36d250432174 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-66433e05-5ddb-46b9-90d1-701ba7bf1144-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:53 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:53 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0760da64-9c0f-4524-b676-fa19a72df9a5 Sep 04 06:15:53 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:53 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.info Sep 04 06:15:53 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:53 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 1G" returned: 0 in 0.557s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Downloaded image 2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'metadata': {}}])) to volume 3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Temporary image 2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0 for user 3a674685a7fd4af8bf17f9495fed82b8 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 06:15:53 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Marking volume 3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Copying metadata from image 2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0 to 3208d9f1-44d8-41d3-b2eb-c9bed9679fa2. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Creating volume glance metadata for volume 3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 backed by image 2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0 with: {'image_id': '2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ce93a5d5083db117b70146a9ca6e478a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 06:15:54 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD" returned: 1 in 0.479s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] 40fba0eb-28c2-4d58-9f8c-1729d984d248 was raw, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:54 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd Sep 04 06:15:54 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b1c18c-bd95-4d58-9dc1-8b4cae5e2e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2', 'volume_size': 1, 'image_id': '2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce93a5d5083db117b70146a9ca6e478a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98194a8dba204f4a80363b3faf17c396', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fcfa4de53a7231e602e14e66f5cc888b6da331f695a549ee9caee639c3c87b8a3286f347f757a316077151aa0783ee2a611be86a2bacfe30eba3d2fbcd6a122d', 'id': '2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0', 'created_at': datetime.datetime(2026, 9, 4, 4, 15, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 15, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ae4d1d6-864b-4adf-891e-f7ec79e8d9c0/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1909e73-bcfd-4881-a969-ffd25c716bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:54 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:54 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Volume volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 (3208d9f1-44d8-41d3-b2eb-c9bed9679fa2): created successfully Sep 04 06:15:54 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1909e73-bcfd-4881-a969-ffd25c716bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Flow 'volume_create_manager' (0706f439-c68a-445e-bfc3-86e6030b1568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0760da64-9c0f-4524-b676-fa19a72df9a5" returned: 0 in 0.585s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0760da64-9c0f-4524-b676-fa19a72df9a5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.info" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:54 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.info is being set with open permissions: ugo+rw Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:54 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0760da64-9c0f-4524-b676-fa19a72df9a5 Sep 04 06:15:54 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3965e570-ae14-4662-a99f-5e08af0e32c0 tempest-VolumeImageDependencyTests-212931504 None] Created volume successfully. Sep 04 06:15:54 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.info Sep 04 06:15:54 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:54 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.info" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.672s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:54 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Acquiring lock "cinder-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0760da64-9c0f-4524-b676-fa19a72df9a5" returned: 0 in 0.358s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-quobyte-0760da64-9c0f-4524-b676-fa19a72df9a5" released by "delete_volume" :: held 1.006s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Lock "cinder-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6f053f45-0644-412e-987c-b59a5c19a454 tempest-CinderUnicodeTest-127673988 None] Create snapshot completed successfully Sep 04 06:15:54 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd" returned: 0 in 0.633s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_40fba0eb-28c2-4d58-9f8c-1729d984d248_mu36ks19devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:15:54 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Acquiring lock "cinder-quobyte-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:54 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd 1G Sep 04 06:15:54 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Created reservations ['e78bc14f-6eb4-42bc-a568-212f520ca2ac', '3d6dfe23-4a72-4ae3-b809-2af0bf6f5317', '3f1760e0-ac13-424d-8168-ea7a1b59c0a0', 'b8c6539f-6705-41f6-a68f-56a65b1891e1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Lock "cinder-quobyte-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[22afd080-9763-416c-93cc-84bd02ea4046]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:54 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:54 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:54 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 Sep 04 06:15:54 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:55 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd 1G" returned: 0 in 0.359s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Downloaded image 40fba0eb-28c2-4d58-9f8c-1729d984d248 ((None, [{'url': 'file:///opt/stack/data/glance/images/40fba0eb-28c2-4d58-9f8c-1729d984d248', 'metadata': {}}])) to volume 3b3316f7-1ac3-4877-9701-9110b64531dd successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Temporary image 40fba0eb-28c2-4d58-9f8c-1729d984d248 for user 293a786351a04c8990d673e4f89e6d9a is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Marking volume 3b3316f7-1ac3-4877-9701-9110b64531dd as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Copying metadata from image 40fba0eb-28c2-4d58-9f8c-1729d984d248 to 3b3316f7-1ac3-4877-9701-9110b64531dd. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Creating volume glance metadata for volume 3b3316f7-1ac3-4877-9701-9110b64531dd backed by image 40fba0eb-28c2-4d58-9f8c-1729d984d248 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '40fba0eb-28c2-4d58-9f8c-1729d984d248', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '403d116271ea6dba985374250f7f99fc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e927df-e2b2-4fb4-823e-d17ca9702dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3316f7-1ac3-4877-9701-9110b64531dd', 'volume_size': 1, 'image_id': '40fba0eb-28c2-4d58-9f8c-1729d984d248', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40fba0eb-28c2-4d58-9f8c-1729d984d248', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '403d116271ea6dba985374250f7f99fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '286a1942dc224dd1b121d4c9778fcf39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ec4c92f5c1ada3fe273bb1023a140eabba17d3a3e7ca33938dfe7186746010519d231961182a594fc94977306af7e2a9664380df8582d5d811691a073974c65', 'id': '40fba0eb-28c2-4d58-9f8c-1729d984d248', 'created_at': datetime.datetime(2026, 9, 4, 4, 15, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 15, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40fba0eb-28c2-4d58-9f8c-1729d984d248/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:55 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b0e7fd-d5a1-4d22-bd94-836e744e25f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Deleted volume successfully. Sep 04 06:15:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Volume volume-3b3316f7-1ac3-4877-9701-9110b64531dd (3b3316f7-1ac3-4877-9701-9110b64531dd): created successfully Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b0e7fd-d5a1-4d22-bd94-836e744e25f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Flow 'volume_create_manager' (8c1a9abc-7d7d-4f7c-a146-218623c4f831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3c2c8aa-d8e8-4820-bb9d-1fdaf15ae9e0 tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-0760da64-9c0f-4524-b676-fa19a72df9a5-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0bfef382-e69e-468c-a52d-4b6aefcddda4 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Created volume successfully. Sep 04 06:15:55 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2" returned: 0 in 0.453s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:55 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2 Sep 04 06:15:55 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Acquiring lock "cinder-3b3316f7-1ac3-4877-9701-9110b64531dd-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Lock "cinder-3b3316f7-1ac3-4877-9701-9110b64531dd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Acquiring lock "cinder-quobyte-3b3316f7-1ac3-4877-9701-9110b64531dd" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Lock "cinder-quobyte-3b3316f7-1ac3-4877-9701-9110b64531dd" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:55 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2665b91-5535-4a57-90a0-af4c58646a60]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Lock "cinder-quobyte-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2" released by "delete_volume" :: held 0.798s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Created reservations ['2cc8bc0c-238b-4008-a406-0ba143a66e43', 'e311c66c-25c4-41d7-a7e1-65aaa1c0ccf8', 'a23d9765-daee-4224-99ff-b92a59123bd4', 'fff3ec88-998b-42fb-8dfe-266ba5138fa8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:55 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd Sep 04 06:15:55 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:55 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:55 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Acquiring lock "cinder-2858edaf-d0a3-47dd-981d-f755112ca6ac-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "cinder-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Lock "cinder-2858edaf-d0a3-47dd-981d-f755112ca6ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Acquiring lock "cinder-quobyte-873286e2-7bf1-4007-8894-2fd234a8f16d" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Lock "cinder-quobyte-873286e2-7bf1-4007-8894-2fd234a8f16d" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Acquiring lock "cinder-quobyte-2858edaf-d0a3-47dd-981d-f755112ca6ac" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "cinder-quobyte-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Lock "cinder-quobyte-2858edaf-d0a3-47dd-981d-f755112ca6ac" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Deleting offline snapshot 2858edaf-d0a3-47dd-981d-f755112ca6ac of volume 873286e2-7bf1-4007-8894-2fd234a8f16d {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] snapshot_file for this snap is: volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-quobyte-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5" acquired by "delete_volume" :: waited 0.061s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf3580c-6fd3-442d-aebf-20ba5869a074]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:56 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[115cf933-7882-4f78-8e86-b31992e60ff8]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd" returned: 0 in 0.615s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:56 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.497s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Deleted volume successfully. Sep 04 06:15:56 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd Sep 04 06:15:56 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b231772-b786-4785-9820-acd12b5cbf81 tempest-VolumeImageDependencyTests-212931504 None] Lock "cinder-3208d9f1-44d8-41d3-b2eb-c9bed9679fa2-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:56 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac Sep 04 06:15:56 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:56 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5 Sep 04 06:15:56 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:56 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3b3316f7-1ac3-4877-9701-9110b64531dd" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Lock "cinder-quobyte-3b3316f7-1ac3-4877-9701-9110b64531dd" released by "delete_volume" :: held 1.027s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:56 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac" returned: 0 in 0.519s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-873286e2-7bf1-4007-8894-2fd234a8f16d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Created reservations ['d8aa3c5f-97aa-40e7-96a2-edc6828b1493', '594d1c75-4fdd-4287-bf17-c187bd1321d1', '4841bdab-6f51-45c5-9cd4-89387b1c7d96', '7b30d60b-999d-4c9a-9325-fee1dc020b51'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f29461-e729-447a-8540-d1e1927cb177]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:56 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5" returned: 0 in 0.556s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:56 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5 Sep 04 06:15:56 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:56 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d Sep 04 06:15:56 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:56 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:56 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:57 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5" returned: 0 in 0.422s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-quobyte-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5" released by "delete_volume" :: held 1.036s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:57 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d" returned: 0 in 0.528s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:57 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:57 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac Sep 04 06:15:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Deleted volume successfully. Sep 04 06:15:57 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Created reservations ['7c0859a5-bb47-4101-b3cc-fe97965136de', '84d42cec-c964-4573-b2e8-d3f35ea5bba0', '034897d1-636d-4370-8a86-a1f3e04f9921', '6e3b95cf-c0d5-43f3-b1c6-ea15f57c1a7b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7d5c3e24-426b-4353-97e7-d54001708590 tempest-VolumeAndVolumeTypeFromImageTest-105421670 None] Lock "cinder-3b3316f7-1ac3-4877-9701-9110b64531dd-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:57 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:15:57 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:57 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac" returned: 0 in 0.488s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:57 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac Sep 04 06:15:57 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:57 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:15:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Deleted volume successfully. Sep 04 06:15:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70e944b8-3711-406b-adf9-78f2b4622a9c tempest-CreateVolumesFromImageTest-1969670162 None] Lock "cinder-b0bb0b46-4d79-4dfa-b521-a60dc7a65fc5-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:58 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d.2858edaf-d0a3-47dd-981d-f755112ca6ac" returned: 0 in 0.444s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Lock "cinder-quobyte-2858edaf-d0a3-47dd-981d-f755112ca6ac" released by "_delete_snapshot" :: held 2.156s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Lock "cinder-quobyte-873286e2-7bf1-4007-8894-2fd234a8f16d" released by "delete_snapshot" :: held 2.238s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Created reservations ['0f3c7268-90a9-4efc-84a8-0931801d4535', 'c5055dde-a027-4d5d-8e25-dec6ab3b5f74', 'd02d8354-cc26-46bc-a73c-6585ba1dc95d', '26366611-a325-4741-b0e2-1d382eae92c1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:15:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Delete snapshot completed successfully. Sep 04 06:15:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-650107fd-56dc-47b0-a078-fe8af7f21cc2 tempest-CinderUnicodeTest-127673988 None] Lock "cinder-2858edaf-d0a3-47dd-981d-f755112ca6ac-delete_snapshot" released by "delete_snapshot" :: held 2.439s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:15:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Acquiring lock "cinder-873286e2-7bf1-4007-8894-2fd234a8f16d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Lock "cinder-873286e2-7bf1-4007-8894-2fd234a8f16d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Acquiring lock "cinder-quobyte-873286e2-7bf1-4007-8894-2fd234a8f16d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:15:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Lock "cinder-quobyte-873286e2-7bf1-4007-8894-2fd234a8f16d" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:15:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[47772ed9-fba9-4be7-a1a8-f22a3f6521d8]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:15:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:59 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d Sep 04 06:15:59 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:15:59 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 04 06:15:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d" returned: 0 in 0.462s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:15:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:15:59 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d Sep 04 06:15:59 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:00 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-873286e2-7bf1-4007-8894-2fd234a8f16d" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Lock "cinder-quobyte-873286e2-7bf1-4007-8894-2fd234a8f16d" released by "delete_volume" :: held 0.867s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Created reservations ['08d2c42f-7ff3-4a32-8f13-12ccbce2a276', 'f3023637-8972-4c18-a6bd-b643a3565c3b', '60a8599a-2375-4710-9092-28ba3276be4d', 'e5e0bcbd-ff69-4eef-90ef-3804493007e6'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:00 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:00 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Acquiring lock "cinder-f3ca1c45-7d7d-4289-9c58-d56013caef4a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Lock "cinder-f3ca1c45-7d7d-4289-9c58-d56013caef4a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Acquiring lock "cinder-quobyte-f3ca1c45-7d7d-4289-9c58-d56013caef4a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Lock "cinder-quobyte-f3ca1c45-7d7d-4289-9c58-d56013caef4a" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d933098-153d-414a-9822-6b19e73732a7]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:00 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.467s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Deleted volume successfully. Sep 04 06:16:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-03e3a3eb-80be-4c5c-a26c-cd97d636449e tempest-CinderUnicodeTest-127673988 None] Lock "cinder-873286e2-7bf1-4007-8894-2fd234a8f16d-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:01 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a Sep 04 06:16:01 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:01 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a" returned: 0 in 0.579s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:01 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a Sep 04 06:16:01 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:01 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f3ca1c45-7d7d-4289-9c58-d56013caef4a" returned: 0 in 0.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Lock "cinder-quobyte-f3ca1c45-7d7d-4289-9c58-d56013caef4a" released by "delete_volume" :: held 0.975s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:01 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Created reservations ['5e1c3cbb-8447-4f01-ab81-e4f3b0e636c6', '232991c6-826c-4050-86e3-20ce9c7539bd', '8f7c554b-2327-46dd-8fe3-531757759de3', '455a1e6b-a1e1-4907-b3b2-cf02b3afd85b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:01 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:01 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:02 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Deleted volume successfully. Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da12ae44-749f-4cce-865e-fc63a93fd97a tempest-CinderUnicodeTest-127673988 None] Lock "cinder-f3ca1c45-7d7d-4289-9c58-d56013caef4a-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Flow 'volume_create_manager' (1099fad8-c4c5-4108-8671-fcef010105c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388a637e-293d-413d-9986-7ff58db02849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388a637e-293d-413d-9986-7ff58db02849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1954331216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c63befcf-f97e-44cf-9afb-662b8487a693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854ab7dce5244b95860c33134c760f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:03Z,use_quota=True,user_id='8c4e6d08994d4b48a851c6a9858a3d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cf1413-d88b-4aa8-98a6-e2d9e4ff177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cf1413-d88b-4aa8-98a6-e2d9e4ff177f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd0a80f-dc04-4ec2-927a-56ebc1fd8637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd0a80f-dc04-4ec2-927a-56ebc1fd8637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c63befcf-f97e-44cf-9afb-662b8487a693', 'volume_name': 'volume-c63befcf-f97e-44cf-9afb-662b8487a693', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d982e2e-770a-40fa-a528-5c82ee16d726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d982e2e-770a-40fa-a528-5c82ee16d726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2f5faa-802d-4722-8744-8f0c83a955b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume c63befcf-f97e-44cf-9afb-662b8487a693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c63befcf-f97e-44cf-9afb-662b8487a693', 'volume_size': 1} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1954331216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c63befcf-f97e-44cf-9afb-662b8487a693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854ab7dce5244b95860c33134c760f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:03Z,use_quota=True,user_id='8c4e6d08994d4b48a851c6a9858a3d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Creating volume c63befcf-f97e-44cf-9afb-662b8487a693 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:02 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:02 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 1073741824 Sep 04 06:16:02 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:03 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 1073741824" returned: 0 in 0.503s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:03 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 Sep 04 06:16:03 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:03 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693" returned: 0 in 0.294s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2f5faa-802d-4722-8744-8f0c83a955b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c63befcf-f97e-44cf-9afb-662b8487a693', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf6e9f2-3037-4409-84c6-09aacf107d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume volume-c63befcf-f97e-44cf-9afb-662b8487a693 (c63befcf-f97e-44cf-9afb-662b8487a693): created successfully Sep 04 06:16:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf6e9f2-3037-4409-84c6-09aacf107d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Flow 'volume_create_manager' (1099fad8-c4c5-4108-8671-fcef010105c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b6404444-6393-4233-aad4-6a4232289e7a tempest-CreateVolumesFromSnapshotTest-322726328 None] Created volume successfully. Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Flow 'volume_create_manager' (d2be00de-fd35-4182-a849-a7956baec178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dde84f5-ca7d-4b0f-8ba3-2084cf275031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dde84f5-ca7d-4b0f-8ba3-2084cf275031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-629137608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6128c2-6ed0-4fb3-9694-34643512ca5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17a80fcbe53466783bb34a6bbb3549e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:05Z,use_quota=True,user_id='0a4a45970ba6463e85d42d5e5429db64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9308252c-5477-49d2-99fa-657662dcd706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9308252c-5477-49d2-99fa-657662dcd706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2951c758-6b26-4670-bd01-a22fc13b700c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2951c758-6b26-4670-bd01-a22fc13b700c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba6128c2-6ed0-4fb3-9694-34643512ca5c', 'volume_name': 'volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde459be-6972-4667-9786-d7fb24721fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde459be-6972-4667-9786-d7fb24721fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698f9c07-19f8-4f7c-8295-c13c5862866c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Volume ba6128c2-6ed0-4fb3-9694-34643512ca5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c', 'volume_size': 1} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-629137608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6128c2-6ed0-4fb3-9694-34643512ca5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17a80fcbe53466783bb34a6bbb3549e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:05Z,use_quota=True,user_id='0a4a45970ba6463e85d42d5e5429db64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Creating volume ba6128c2-6ed0-4fb3-9694-34643512ca5c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:04 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:05 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c 1073741824 Sep 04 06:16:05 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:05 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c 1073741824" returned: 0 in 0.525s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:05 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c Sep 04 06:16:05 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:05 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.756s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698f9c07-19f8-4f7c-8295-c13c5862866c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd37df0-1890-40f2-aec4-c2d0fd7c6f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] Creating offline snapshot 164d7137-91c1-476b-92b9-b4074aca22d6 of volume c63befcf-f97e-44cf-9afb-662b8487a693 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:16:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Volume volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c (ba6128c2-6ed0-4fb3-9694-34643512ca5c): created successfully Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd37df0-1890-40f2-aec4-c2d0fd7c6f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Flow 'volume_create_manager' (d2be00de-fd35-4182-a849-a7956baec178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc90ca55-9fb5-4367-bae5-b1c98c89d30b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2c87b28a-cf9a-4503-8b04-de57811543fa tempest-VolumeDependencyTests-1046430067 None] Created volume successfully. Sep 04 06:16:06 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 Sep 04 06:16:06 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:06 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693" returned: 0 in 0.384s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:06 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 1G Sep 04 06:16:06 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:06 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 1G" returned: 0 in 0.460s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c63befcf-f97e-44cf-9afb-662b8487a693 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:06 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c63befcf-f97e-44cf-9afb-662b8487a693 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 Sep 04 06:16:06 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:07 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c63befcf-f97e-44cf-9afb-662b8487a693 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6" returned: 0 in 0.452s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:07 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 is being set with open permissions: ugo+rw Sep 04 06:16:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:07 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 Sep 04 06:16:07 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:07 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6" returned: 0 in 0.314s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:07 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.info Sep 04 06:16:07 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ceefbfc2-b131-4e32-8c48-fe405caa1302 tempest-ProjectAdminTests-1367957604 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8068084716797, 'free_capacity_gb': 1773.8068084716797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87132) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 06:16:07 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.info" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:07 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.info is being set with open permissions: ugo+rw Sep 04 06:16:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:07 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.info Sep 04 06:16:07 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:08 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.info" returned: 0 in 0.264s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.313s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.888s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] Creating offline snapshot 4bb4fded-d0ac-4df5-978f-2b161da2a2be of volume ba6128c2-6ed0-4fb3-9694-34643512ca5c {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:16:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9726cdfa-7585-475a-9883-b42faff37090 tempest-CreateVolumesFromSnapshotTest-322726328 None] Create snapshot completed successfully Sep 04 06:16:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e23ffd8-583c-495f-8fc7-fa598a6331e4]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:08 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c Sep 04 06:16:08 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:08 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c" returned: 0 in 0.389s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:08 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be 1G Sep 04 06:16:08 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Flow 'volume_create_manager' (5074d9d6-9b2b-49e8-b272-6a08e7b75251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fb0918-00df-442d-8098-ac9df677d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fb0918-00df-442d-8098-ac9df677d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264877237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65e17e9-0c4b-4054-899a-9bab651e9609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854ab7dce5244b95860c33134c760f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:09Z,use_quota=True,user_id='8c4e6d08994d4b48a851c6a9858a3d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af51260-5818-492c-871a-c6112e974a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:09 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af51260-5818-492c-871a-c6112e974a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee76d14-b365-485f-a19c-2fb835ced0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee76d14-b365-485f-a19c-2fb835ced0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65e17e9-0c4b-4054-899a-9bab651e9609', 'volume_name': 'volume-d65e17e9-0c4b-4054-899a-9bab651e9609', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238b1eb5-db33-4c9e-bfe6-d3ac49737dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238b1eb5-db33-4c9e-bfe6-d3ac49737dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8fff4e0-9358-4535-8664-629f20433a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume d65e17e9-0c4b-4054-899a-9bab651e9609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65e17e9-0c4b-4054-899a-9bab651e9609', 'volume_size': 1} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be 1G" returned: 0 in 0.667s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:09 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be Sep 04 06:16:09 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Flow 'volume_create_manager' (5bd52e63-1b95-48a6-ac08-849999ca84c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971e85cc-6f94-4b8e-a314-8a5ece1addda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971e85cc-6f94-4b8e-a314-8a5ece1addda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1725382937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33a7be6-6070-4ae5-a569-4d467201185d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854ab7dce5244b95860c33134c760f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:09Z,use_quota=True,user_id='8c4e6d08994d4b48a851c6a9858a3d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d39d89-0111-47d6-8f87-fb528672a841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d39d89-0111-47d6-8f87-fb528672a841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0839291-4675-4b06-8d86-3d9e7ebd3b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0839291-4675-4b06-8d86-3d9e7ebd3b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e33a7be6-6070-4ae5-a569-4d467201185d', 'volume_name': 'volume-e33a7be6-6070-4ae5-a569-4d467201185d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:09 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbe2642-a786-4ecd-adbe-4e7cb84c7799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbe2642-a786-4ecd-adbe-4e7cb84c7799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3151280f-ef3c-405c-971d-708bdf53a091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume e33a7be6-6070-4ae5-a569-4d467201185d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e33a7be6-6070-4ae5-a569-4d467201185d', 'volume_size': 1} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be" returned: 0 in 0.526s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:09 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be is being set with open permissions: ugo+rw Sep 04 06:16:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:09 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be Sep 04 06:16:09 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:10 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be" returned: 0 in 0.395s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:10 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.info Sep 04 06:16:10 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Flow 'volume_create_manager' (4933316b-660b-4ff0-9c11-cf7b5ec7dc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc4c741-6cf8-462b-afa1-ac8f951cbf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc4c741-6cf8-462b-afa1-ac8f951cbf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-318173369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06371266-093b-48f5-9005-9b4c366e0f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854ab7dce5244b95860c33134c760f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:10Z,use_quota=True,user_id='8c4e6d08994d4b48a851c6a9858a3d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c236cfeb-4cc1-4423-bf1f-5b769f3cb9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c236cfeb-4cc1-4423-bf1f-5b769f3cb9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4749bcd-ba3b-4d9b-a888-4767cff9e810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4749bcd-ba3b-4d9b-a888-4767cff9e810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06371266-093b-48f5-9005-9b4c366e0f1a', 'volume_name': 'volume-06371266-093b-48f5-9005-9b4c366e0f1a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c84e30-0d9c-4cab-b2af-dc08e3921277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c84e30-0d9c-4cab-b2af-dc08e3921277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39b5d4e-0fe4-40e9-979f-33a281c8fd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume 06371266-093b-48f5-9005-9b4c366e0f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06371266-093b-48f5-9005-9b4c366e0f1a', 'volume_size': 1} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:10 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.info" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:10 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.info is being set with open permissions: ugo+rw Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:10 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.info Sep 04 06:16:10 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Flow 'volume_create_manager' (273324a5-1574-408c-be34-69af66f10a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277dfde5-8919-4034-ab21-9bb1a9593315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277dfde5-8919-4034-ab21-9bb1a9593315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1452365040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6d047e-3cce-46d2-a7bf-65e21ebe73ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854ab7dce5244b95860c33134c760f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:11Z,use_quota=True,user_id='8c4e6d08994d4b48a851c6a9858a3d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d450eb0b-d3d2-4507-8918-f02d246e76bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d450eb0b-d3d2-4507-8918-f02d246e76bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb78d67a-9e7a-4b26-8ee2-46d24aaadb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb78d67a-9e7a-4b26-8ee2-46d24aaadb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6d047e-3cce-46d2-a7bf-65e21ebe73ad', 'volume_name': 'volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12033509-3262-46ac-bdd1-56d06fcf37f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12033509-3262-46ac-bdd1-56d06fcf37f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58aa788f-c317-4555-a3bb-9d871dea53c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume ab6d047e-3cce-46d2-a7bf-65e21ebe73ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad', 'volume_size': 1} Sep 04 06:16:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:11 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.info" returned: 0 in 0.492s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.970s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.879s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264877237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65e17e9-0c4b-4054-899a-9bab651e9609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854ab7dce5244b95860c33134c760f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:09Z,use_quota=True,user_id='8c4e6d08994d4b48a851c6a9858a3d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Creating volume d65e17e9-0c4b-4054-899a-9bab651e9609 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:11 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d65e17e9-0c4b-4054-899a-9bab651e9609 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:11 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d65e17e9-0c4b-4054-899a-9bab651e9609 1073741824 Sep 04 06:16:11 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Flow 'volume_create_manager' (f690139b-592c-446d-97b3-2e2d58850665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c7654f-0fa3-4310-83ea-072a1e67e40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c7654f-0fa3-4310-83ea-072a1e67e40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-63001454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6623ce30-c3f7-4db6-b050-c46b2ff642a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854ab7dce5244b95860c33134c760f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:11Z,use_quota=True,user_id='8c4e6d08994d4b48a851c6a9858a3d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a47e41-52b4-4fe0-a232-b9e14642590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a47e41-52b4-4fe0-a232-b9e14642590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4feafeb-ca1a-4a14-9c2f-2d1ee1691282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4feafeb-ca1a-4a14-9c2f-2d1ee1691282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6623ce30-c3f7-4db6-b050-c46b2ff642a8', 'volume_name': 'volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c77ff6b-3569-41c1-903f-09bfc44bb091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c77ff6b-3569-41c1-903f-09bfc44bb091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286b2acf-ab45-4c62-86a3-051d6cf00a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume 6623ce30-c3f7-4db6-b050-c46b2ff642a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8', 'volume_size': 1} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b005c52d-4704-441b-8451-4ea950b6b783 tempest-VolumeDependencyTests-1046430067 None] Create snapshot completed successfully Sep 04 06:16:11 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d65e17e9-0c4b-4054-899a-9bab651e9609 1073741824" returned: 0 in 0.508s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d65e17e9-0c4b-4054-899a-9bab651e9609 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:11 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d65e17e9-0c4b-4054-899a-9bab651e9609 Sep 04 06:16:11 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:12 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d65e17e9-0c4b-4054-899a-9bab651e9609" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.273s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1725382937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33a7be6-6070-4ae5-a569-4d467201185d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854ab7dce5244b95860c33134c760f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:09Z,use_quota=True,user_id='8c4e6d08994d4b48a851c6a9858a3d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Creating volume e33a7be6-6070-4ae5-a569-4d467201185d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:12 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e33a7be6-6070-4ae5-a569-4d467201185d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8fff4e0-9358-4535-8664-629f20433a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65e17e9-0c4b-4054-899a-9bab651e9609', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe1d67b-262f-409e-8677-85edb67857ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:12 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e33a7be6-6070-4ae5-a569-4d467201185d 1073741824 Sep 04 06:16:12 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume volume-d65e17e9-0c4b-4054-899a-9bab651e9609 (d65e17e9-0c4b-4054-899a-9bab651e9609): created successfully Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe1d67b-262f-409e-8677-85edb67857ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Flow 'volume_create_manager' (5074d9d6-9b2b-49e8-b272-6a08e7b75251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-24fd773f-ce1e-42c9-968a-c5304b8f23f9 tempest-CreateVolumesFromSnapshotTest-322726328 None] Created volume successfully. Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Flow 'volume_create_manager' (f040e80c-30ad-460d-bc5a-5f1cda27ab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca073c6-56d5-4767-99fa-5b46c7332ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:12 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca073c6-56d5-4767-99fa-5b46c7332ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-841094116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0708e48c-39a7-4606-be2d-6c7c19494d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17a80fcbe53466783bb34a6bbb3549e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4bb4fded-d0ac-4df5-978f-2b161da2a2be,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:13Z,use_quota=True,user_id='0a4a45970ba6463e85d42d5e5429db64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8d2d66-bb89-41a4-9f4c-24abcf962196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8d2d66-bb89-41a4-9f4c-24abcf962196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3723826-4472-433a-a4b4-f44b2b59309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3723826-4472-433a-a4b4-f44b2b59309c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0708e48c-39a7-4606-be2d-6c7c19494d0c', 'volume_name': 'volume-0708e48c-39a7-4606-be2d-6c7c19494d0c', 'volume_size': 1, 'snapshot_id': '4bb4fded-d0ac-4df5-978f-2b161da2a2be'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bbb9d8-ac4f-4815-812b-c6188ecea002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bbb9d8-ac4f-4815-812b-c6188ecea002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a7068e-cfef-4039-befd-115ce385f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Volume 0708e48c-39a7-4606-be2d-6c7c19494d0c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0708e48c-39a7-4606-be2d-6c7c19494d0c', 'volume_size': 1, 'snapshot_id': '4bb4fded-d0ac-4df5-978f-2b161da2a2be'} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e33a7be6-6070-4ae5-a569-4d467201185d 1073741824" returned: 0 in 0.615s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e33a7be6-6070-4ae5-a569-4d467201185d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:12 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e33a7be6-6070-4ae5-a569-4d467201185d Sep 04 06:16:12 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:13 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e33a7be6-6070-4ae5-a569-4d467201185d" returned: 0 in 0.299s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.510s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-318173369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06371266-093b-48f5-9005-9b4c366e0f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854ab7dce5244b95860c33134c760f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:10Z,use_quota=True,user_id='8c4e6d08994d4b48a851c6a9858a3d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Creating volume 06371266-093b-48f5-9005-9b4c366e0f1a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:13 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-06371266-093b-48f5-9005-9b4c366e0f1a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:13 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-06371266-093b-48f5-9005-9b4c366e0f1a 1073741824 Sep 04 06:16:13 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3151280f-ef3c-405c-971d-708bdf53a091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e33a7be6-6070-4ae5-a569-4d467201185d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0ea673-f182-4132-b9f6-64c6604fe83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume volume-e33a7be6-6070-4ae5-a569-4d467201185d (e33a7be6-6070-4ae5-a569-4d467201185d): created successfully Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0ea673-f182-4132-b9f6-64c6604fe83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Flow 'volume_create_manager' (5bd52e63-1b95-48a6-ac08-849999ca84c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6e4d4dcf-dd12-45f2-bc48-9a5079905c99 tempest-CreateVolumesFromSnapshotTest-322726328 None] Created volume successfully. Sep 04 06:16:13 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-06371266-093b-48f5-9005-9b4c366e0f1a 1073741824" returned: 0 in 0.599s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-06371266-093b-48f5-9005-9b4c366e0f1a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:13 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-06371266-093b-48f5-9005-9b4c366e0f1a Sep 04 06:16:13 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:13 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-06371266-093b-48f5-9005-9b4c366e0f1a" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.199s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1452365040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6d047e-3cce-46d2-a7bf-65e21ebe73ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854ab7dce5244b95860c33134c760f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:11Z,use_quota=True,user_id='8c4e6d08994d4b48a851c6a9858a3d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Creating volume ab6d047e-3cce-46d2-a7bf-65e21ebe73ad {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:13 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:14 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad 1073741824 Sep 04 06:16:14 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39b5d4e-0fe4-40e9-979f-33a281c8fd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06371266-093b-48f5-9005-9b4c366e0f1a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7813ad14-aba5-48bd-9c36-0286c74e780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume volume-06371266-093b-48f5-9005-9b4c366e0f1a (06371266-093b-48f5-9005-9b4c366e0f1a): created successfully Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7813ad14-aba5-48bd-9c36-0286c74e780f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Flow 'volume_create_manager' (4933316b-660b-4ff0-9c11-cf7b5ec7dc84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b79814cb-b1c5-4a87-9312-14f18e3d1cdf tempest-CreateVolumesFromSnapshotTest-322726328 None] Created volume successfully. Sep 04 06:16:14 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad 1073741824" returned: 0 in 0.570s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:14 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad Sep 04 06:16:14 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:14 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad" returned: 0 in 0.337s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.681s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-63001454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6623ce30-c3f7-4db6-b050-c46b2ff642a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854ab7dce5244b95860c33134c760f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:11Z,use_quota=True,user_id='8c4e6d08994d4b48a851c6a9858a3d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Creating volume 6623ce30-c3f7-4db6-b050-c46b2ff642a8 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:14 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58aa788f-c317-4555-a3bb-9d871dea53c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ccfe4b-cb74-4668-a8bd-36d0a06e65fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:15 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8 1073741824 Sep 04 06:16:15 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad (ab6d047e-3cce-46d2-a7bf-65e21ebe73ad): created successfully Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ccfe4b-cb74-4668-a8bd-36d0a06e65fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Flow 'volume_create_manager' (273324a5-1574-408c-be34-69af66f10a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6eb9095f-a0ec-4cfd-a55f-671d7457418a tempest-CreateVolumesFromSnapshotTest-322726328 None] Created volume successfully. Sep 04 06:16:15 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8 1073741824" returned: 0 in 0.555s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:15 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8 Sep 04 06:16:15 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:15 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8" returned: 0 in 0.330s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.214s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "cinder-quobyte-4bb4fded-d0ac-4df5-978f-2b161da2a2be-0708e48c-39a7-4606-be2d-6c7c19494d0c" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286b2acf-ab45-4c62-86a3-051d6cf00a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19ee65a-36ed-4e58-8d3a-044b872160c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Volume volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8 (6623ce30-c3f7-4db6-b050-c46b2ff642a8): created successfully Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19ee65a-36ed-4e58-8d3a-044b872160c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Flow 'volume_create_manager' (f690139b-592c-446d-97b3-2e2d58850665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-quobyte-4bb4fded-d0ac-4df5-978f-2b161da2a2be-0708e48c-39a7-4606-be2d-6c7c19494d0c" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Creating volume 0708e48c-39a7-4606-be2d-6c7c19494d0c from snapshot 4bb4fded-d0ac-4df5-978f-2b161da2a2be {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "cinder-quobyte-0708e48c-39a7-4606-be2d-6c7c19494d0c" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dcfc034a-3e97-48d7-9279-b02ce26a8b01 tempest-CreateVolumesFromSnapshotTest-322726328 None] Created volume successfully. Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-quobyte-0708e48c-39a7-4606-be2d-6c7c19494d0c" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] snapshot: 4bb4fded-d0ac-4df5-978f-2b161da2a2be, volume: 0708e48c-39a7-4606-be2d-6c7c19494d0c, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f3ddd9-8d3f-4270-88c0-d8b5eebf87e4]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:16 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be Sep 04 06:16:16 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:16 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be" returned: 0 in 0.439s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[765276d0-be7c-4806-a33f-de113356a557]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:16 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c Sep 04 06:16:16 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-6623ce30-c3f7-4db6-b050-c46b2ff642a8-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-6623ce30-c3f7-4db6-b050-c46b2ff642a8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-quobyte-6623ce30-c3f7-4db6-b050-c46b2ff642a8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-6623ce30-c3f7-4db6-b050-c46b2ff642a8" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:17 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c" returned: 0 in 0.488s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] will copy from snapshot at /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Path /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2ca655-cd86-4be8-a307-5bf030028147]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:17 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c Sep 04 06:16:17 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:17 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8 Sep 04 06:16:17 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:17 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:17 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8 Sep 04 06:16:17 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:17 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6623ce30-c3f7-4db6-b050-c46b2ff642a8" returned: 0 in 0.408s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-6623ce30-c3f7-4db6-b050-c46b2ff642a8" released by "delete_volume" :: held 0.907s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:17 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Flow 'volume_create_manager' (1231d9bf-a926-41b1-9900-274858ca59c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87aaf9ad-b65e-430b-aa2a-37ade29eb468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87aaf9ad-b65e-430b-aa2a-37ade29eb468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-465298484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6adfee8ab074944885bfa748071e1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:18Z,use_quota=True,user_id='d9f0daa8cf0d439ca234aa2d5da55dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ae8075-9474-42bd-9bb0-03d0b7bfaaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ae8075-9474-42bd-9bb0-03d0b7bfaaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9983baf-8617-4772-9c06-43732a8b7cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9983baf-8617-4772-9c06-43732a8b7cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6', 'volume_name': 'volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55bce8e-0ccb-41bf-bfff-5acc3d790ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55bce8e-0ccb-41bf-bfff-5acc3d790ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f4dadb-3f1d-4d6a-b3b3-8c33872b9d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Volume a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6', 'volume_size': 1} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Created reservations ['4962e062-3b95-4e0a-a14f-5c6831c7df7c', '27e11e3a-8fe6-463d-839f-caa35d25ee3e', '94ae0fc8-4005-4c64-94dd-83e7b29d70a4', '45e34ebc-baf4-40af-8546-8e6dd82839ea'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:18 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:18 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:19 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.599s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:19 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Deleted volume successfully. Sep 04 06:16:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d12421de-c6fb-4e69-a7f0-dd48c7bcaa7b tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-6623ce30-c3f7-4db6-b050-c46b2ff642a8-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-quobyte-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9392336-595e-451f-b244-37b50a7ea47f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:20 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad Sep 04 06:16:20 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:20 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad" returned: 0 in 1.097s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:20 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad Sep 04 06:16:20 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:21 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad" returned: 0 in 0.596s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad" released by "delete_volume" :: held 1.817s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Created reservations ['bfc3f62c-c4cb-4177-9a84-da9d2059d860', '98b5c22c-9eb5-498d-9b70-7c5751c69343', 'db3ca1d6-090b-4225-a5b0-09ec8f5eed40', '678dc043-561a-4747-9717-c3b5b7272fe0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:21 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:21 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-06371266-093b-48f5-9005-9b4c366e0f1a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-06371266-093b-48f5-9005-9b4c366e0f1a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-quobyte-06371266-093b-48f5-9005-9b4c366e0f1a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-06371266-093b-48f5-9005-9b4c366e0f1a" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea490dd2-aba9-401f-a709-22305b4c1340]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-06371266-093b-48f5-9005-9b4c366e0f1a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:22 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.767s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:22 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Deleted volume successfully. Sep 04 06:16:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-83828481-0982-4fe9-b288-fa9507d1eadb tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-ab6d047e-3cce-46d2-a7bf-65e21ebe73ad-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:22 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-06371266-093b-48f5-9005-9b4c366e0f1a Sep 04 06:16:22 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:23 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-06371266-093b-48f5-9005-9b4c366e0f1a" returned: 0 in 1.080s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-06371266-093b-48f5-9005-9b4c366e0f1a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:23 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c" returned: 0 in 6.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:23 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:16:23 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Converted 1024.00 MB image at 156.76 MB/s Sep 04 06:16:23 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c is being set with open permissions: ugo+rw Sep 04 06:16:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:23 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-06371266-093b-48f5-9005-9b4c366e0f1a Sep 04 06:16:23 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:23 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c Sep 04 06:16:23 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:23 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-06371266-093b-48f5-9005-9b4c366e0f1a" returned: 0 in 0.288s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-06371266-093b-48f5-9005-9b4c366e0f1a" released by "delete_volume" :: held 1.485s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:23 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Created reservations ['d407222e-0b5a-4a69-8369-462013c5fcb3', '3fd8d19a-6829-4eeb-ae71-537cfe6a3dcc', '9086db23-6926-49f4-bee6-96a142a6aaff', 'e52f18e1-731b-4fc8-a041-bb362f9ddcc2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:23 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c" returned: 0 in 0.401s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-quobyte-0708e48c-39a7-4606-be2d-6c7c19494d0c" released by "_copy_volume_from_snapshot" :: held 8.001s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-quobyte-4bb4fded-d0ac-4df5-978f-2b161da2a2be-0708e48c-39a7-4606-be2d-6c7c19494d0c" released by "_create_volume_from_snapshot" :: held 8.107s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.169s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.831s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-465298484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6adfee8ab074944885bfa748071e1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:18Z,use_quota=True,user_id='d9f0daa8cf0d439ca234aa2d5da55dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Creating volume a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:24 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:24 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6 1073741824 Sep 04 06:16:24 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a7068e-cfef-4039-befd-115ce385f508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0708e48c-39a7-4606-be2d-6c7c19494d0c', 'volume_size': 1, 'snapshot_id': '4bb4fded-d0ac-4df5-978f-2b161da2a2be'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e45288-f139-4778-b732-93f12eab6c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:24 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:24 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Volume volume-0708e48c-39a7-4606-be2d-6c7c19494d0c (0708e48c-39a7-4606-be2d-6c7c19494d0c): created successfully Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e45288-f139-4778-b732-93f12eab6c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Flow 'volume_create_manager' (f040e80c-30ad-460d-bc5a-5f1cda27ab5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3ee809c8-86bf-4bd3-80ec-5645d2ffcfb6 tempest-VolumeDependencyTests-1046430067 None] Created volume successfully. Sep 04 06:16:24 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.330s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Deleted volume successfully. Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-889906c2-ec21-4487-83ab-3e9dc49bc465 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-06371266-093b-48f5-9005-9b4c366e0f1a-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-e33a7be6-6070-4ae5-a569-4d467201185d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:24 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6 1073741824" returned: 0 in 0.597s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-e33a7be6-6070-4ae5-a569-4d467201185d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-quobyte-e33a7be6-6070-4ae5-a569-4d467201185d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:24 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6 Sep 04 06:16:24 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-e33a7be6-6070-4ae5-a569-4d467201185d" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f2ee81-8954-460e-823f-d09fa136483c]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e33a7be6-6070-4ae5-a569-4d467201185d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:24 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e33a7be6-6070-4ae5-a569-4d467201185d Sep 04 06:16:24 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:25 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6" returned: 0 in 0.300s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f4dadb-3f1d-4d6a-b3b3-8c33872b9d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80febfe-14a3-48b6-9d5b-78d7b43f7f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Volume volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6 (a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6): created successfully Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80febfe-14a3-48b6-9d5b-78d7b43f7f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Flow 'volume_create_manager' (1231d9bf-a926-41b1-9900-274858ca59c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "cinder-4bb4fded-d0ac-4df5-978f-2b161da2a2be-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0ce2120a-7ea6-40db-bf92-2c25b8f38afd tempest-ProjectReaderTests-1269743203 None] Created volume successfully. Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-4bb4fded-d0ac-4df5-978f-2b161da2a2be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "cinder-quobyte-ba6128c2-6ed0-4fb3-9694-34643512ca5c" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-quobyte-ba6128c2-6ed0-4fb3-9694-34643512ca5c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "cinder-quobyte-4bb4fded-d0ac-4df5-978f-2b161da2a2be" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-quobyte-4bb4fded-d0ac-4df5-978f-2b161da2a2be" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Deleting offline snapshot 4bb4fded-d0ac-4df5-978f-2b161da2a2be of volume ba6128c2-6ed0-4fb3-9694-34643512ca5c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] snapshot_file for this snap is: volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f6b82d-8eae-4f8d-aaf0-68ba2d961731]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:25 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:25 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:25 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e33a7be6-6070-4ae5-a569-4d467201185d" returned: 0 in 0.532s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e33a7be6-6070-4ae5-a569-4d467201185d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:25 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e33a7be6-6070-4ae5-a569-4d467201185d Sep 04 06:16:25 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:25 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be Sep 04 06:16:25 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:25 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:16:25 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e33a7be6-6070-4ae5-a569-4d467201185d" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-e33a7be6-6070-4ae5-a569-4d467201185d" released by "delete_volume" :: held 0.948s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Created reservations ['f2d68fe2-dc09-4b77-bed9-b6ae78da935b', 'e4093a16-f100-4a5f-b627-f9de7ba04bd0', '1637c869-92ff-4e0d-99cc-8414498c7693', '9c3da525-b733-4ad3-9405-2f42674641e4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:25 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be" returned: 0 in 0.629s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:16:25 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:25 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d083d6-cd6b-44c8-8d4b-f42e20cbfda5]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Acquiring lock "cinder-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Lock "cinder-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Acquiring lock "cinder-quobyte-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Lock "cinder-quobyte-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ddbb58-a178-4489-94da-69d9355b1c65]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.441s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:26 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Deleted volume successfully. Sep 04 06:16:26 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:26 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1ab83733-cd3b-4a0e-bca5-b921ddbeb314 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-e33a7be6-6070-4ae5-a569-4d467201185d-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:26 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6 Sep 04 06:16:26 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:26 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6" returned: 0 in 0.580s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:26 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6 Sep 04 06:16:26 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:26 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-d65e17e9-0c4b-4054-899a-9bab651e9609-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c" returned: 0 in 1.000s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-d65e17e9-0c4b-4054-899a-9bab651e9609-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:27 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be Sep 04 06:16:27 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-quobyte-d65e17e9-0c4b-4054-899a-9bab651e9609" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-d65e17e9-0c4b-4054-899a-9bab651e9609" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:27 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccf84f5-edfe-4b43-83e3-eebad10bbe84]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d65e17e9-0c4b-4054-899a-9bab651e9609 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Lock "cinder-quobyte-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6" released by "delete_volume" :: held 1.048s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Created reservations ['f72820e5-0234-4c77-9cc4-c474bbaae083', '9fbc59ea-887a-44ac-bd84-0fb703aff5ba', '4f0ba2d1-0c2d-47fc-81e1-d2d12788ae30', 'a48bca56-8b7e-407a-8e12-7a4692945fb6'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:27 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d65e17e9-0c4b-4054-899a-9bab651e9609 Sep 04 06:16:27 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:27 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:27 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:27 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be" returned: 0 in 0.654s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:27 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be Sep 04 06:16:27 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:27 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Deleted volume successfully. Sep 04 06:16:27 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d65e17e9-0c4b-4054-899a-9bab651e9609" returned: 0 in 0.636s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d65e17e9-0c4b-4054-899a-9bab651e9609 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b8d28c5-0a42-41ef-8bb1-54299675ca3a tempest-ProjectReaderTests-1269743203 None] Lock "cinder-a7e0a3f8-8a4d-41c0-a8df-fb45650dcfe6-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:27 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d65e17e9-0c4b-4054-899a-9bab651e9609 Sep 04 06:16:27 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:27 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c.4bb4fded-d0ac-4df5-978f-2b161da2a2be" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-quobyte-4bb4fded-d0ac-4df5-978f-2b161da2a2be" released by "_delete_snapshot" :: held 2.794s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-quobyte-ba6128c2-6ed0-4fb3-9694-34643512ca5c" released by "delete_snapshot" :: held 2.840s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Created reservations ['beba9cc8-3763-41d9-9b39-f520e6f5be74', '2fc4cfbe-6324-4537-bde9-a16beb915faa', '39c1a3e8-eba7-4df3-92cb-3b7d593f90dd', '63984ae4-9386-4dd2-ad67-79a4c05af3d2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:28 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-d65e17e9-0c4b-4054-899a-9bab651e9609" returned: 0 in 0.313s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-d65e17e9-0c4b-4054-899a-9bab651e9609" released by "delete_volume" :: held 1.025s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Delete snapshot completed successfully. Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6cedbbb-4b82-4053-84d2-9b48be488b5b tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-4bb4fded-d0ac-4df5-978f-2b161da2a2be-delete_snapshot" released by "delete_snapshot" :: held 3.083s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Created reservations ['183a7f28-8946-464f-be33-7324a266000e', '87cee039-d226-4db3-9e3e-6078c1c20a8f', '118600d2-dbfb-4866-8744-7097a41ca5f4', '809fced3-e3d3-4f53-99cc-1ad39d24daa4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:28 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:28 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "cinder-ba6128c2-6ed0-4fb3-9694-34643512ca5c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-ba6128c2-6ed0-4fb3-9694-34643512ca5c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "cinder-quobyte-ba6128c2-6ed0-4fb3-9694-34643512ca5c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-quobyte-ba6128c2-6ed0-4fb3-9694-34643512ca5c" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ec7d64-1ecf-4d1a-a01b-cf019883ee61]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:28 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Deleted volume successfully. Sep 04 06:16:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-064331a0-d0f0-4137-869c-b8ccfdacba75 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-d65e17e9-0c4b-4054-899a-9bab651e9609-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:28 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c Sep 04 06:16:28 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Flow 'volume_create_manager' (203a04c2-37a3-4657-93b3-dd50f8f54289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722a48a5-01d6-438a-914c-4dbe9a8b0b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:29 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c" returned: 0 in 0.449s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722a48a5-01d6-438a-914c-4dbe9a8b0b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423452166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d932d94-6bd2-4ab6-8ec2-e49386f80014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6adfee8ab074944885bfa748071e1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:29Z,use_quota=True,user_id='d9f0daa8cf0d439ca234aa2d5da55dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:29 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c Sep 04 06:16:29 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dbdf792-c89f-4358-a770-ef6189f68d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dbdf792-c89f-4358-a770-ef6189f68d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e55207-3611-4240-a383-053d53231933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e55207-3611-4240-a383-053d53231933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d932d94-6bd2-4ab6-8ec2-e49386f80014', 'volume_name': 'volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b85217-e064-4ac4-a5d8-9fbe69362e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b85217-e064-4ac4-a5d8-9fbe69362e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1637db7-f582-4c6b-844e-9564c9a63558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Volume 7d932d94-6bd2-4ab6-8ec2-e49386f80014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014', 'volume_size': 1} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423452166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d932d94-6bd2-4ab6-8ec2-e49386f80014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6adfee8ab074944885bfa748071e1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:29Z,use_quota=True,user_id='d9f0daa8cf0d439ca234aa2d5da55dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Creating volume 7d932d94-6bd2-4ab6-8ec2-e49386f80014 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:29 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:29 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014 1073741824 Sep 04 06:16:29 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-164d7137-91c1-476b-92b9-b4074aca22d6-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-164d7137-91c1-476b-92b9-b4074aca22d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-quobyte-c63befcf-f97e-44cf-9afb-662b8487a693" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-c63befcf-f97e-44cf-9afb-662b8487a693" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-quobyte-164d7137-91c1-476b-92b9-b4074aca22d6" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-164d7137-91c1-476b-92b9-b4074aca22d6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Deleting offline snapshot 164d7137-91c1-476b-92b9-b4074aca22d6 of volume c63befcf-f97e-44cf-9afb-662b8487a693 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:16:29 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] snapshot_file for this snap is: volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-ba6128c2-6ed0-4fb3-9694-34643512ca5c" returned: 0 in 0.375s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84b7f67-694b-418d-ad8d-3fea34d3e6cb]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-quobyte-ba6128c2-6ed0-4fb3-9694-34643512ca5c" released by "delete_volume" :: held 0.932s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Created reservations ['24545df5-4f2e-42e5-bc65-9b5a1be9533a', '5dfe7446-cd6b-4923-ad4f-55d9d027bb23', '8cbdf758-f177-4f22-8b1a-a894f948243c', '957c9add-bbdf-4f8b-b310-5f5c87d7a85d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:29 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 Sep 04 06:16:29 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:29 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:29 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:29 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014 1073741824" returned: 0 in 0.680s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:29 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014 Sep 04 06:16:29 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:29 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6" returned: 0 in 0.499s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c63befcf-f97e-44cf-9afb-662b8487a693(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[af399483-bf66-4d94-89bb-90f72285ffcf]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:30 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Deleted volume successfully. Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b70a22ca-823e-48c6-8d88-7ef07e118263 tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-ba6128c2-6ed0-4fb3-9694-34643512ca5c-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:30 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 Sep 04 06:16:30 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:30 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014" returned: 0 in 0.313s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1637db7-f582-4c6b-844e-9564c9a63558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff9419b-7000-4051-bd1c-2f6e31eadfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Volume volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014 (7d932d94-6bd2-4ab6-8ec2-e49386f80014): created successfully Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff9419b-7000-4051-bd1c-2f6e31eadfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Flow 'volume_create_manager' (203a04c2-37a3-4657-93b3-dd50f8f54289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fcf55bf6-df11-4ddd-a4be-2f9088f514bb tempest-ProjectReaderTests-1269743203 None] Created volume successfully. Sep 04 06:16:30 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:30 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 Sep 04 06:16:30 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "cinder-0708e48c-39a7-4606-be2d-6c7c19494d0c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-0708e48c-39a7-4606-be2d-6c7c19494d0c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "cinder-quobyte-0708e48c-39a7-4606-be2d-6c7c19494d0c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-quobyte-0708e48c-39a7-4606-be2d-6c7c19494d0c" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1acd83-c0fa-402d-9ef2-0e54b1145238]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:30 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6" returned: 0 in 0.474s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:30 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6 Sep 04 06:16:30 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:31 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c Sep 04 06:16:31 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:31 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Acquiring lock "cinder-7d932d94-6bd2-4ab6-8ec2-e49386f80014-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693.164d7137-91c1-476b-92b9-b4074aca22d6" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Lock "cinder-7d932d94-6bd2-4ab6-8ec2-e49386f80014-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-164d7137-91c1-476b-92b9-b4074aca22d6" released by "_delete_snapshot" :: held 1.891s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-c63befcf-f97e-44cf-9afb-662b8487a693" released by "delete_snapshot" :: held 1.919s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:31 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c" returned: 0 in 0.463s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Acquiring lock "cinder-quobyte-7d932d94-6bd2-4ab6-8ec2-e49386f80014" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:31 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c Sep 04 06:16:31 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Lock "cinder-quobyte-7d932d94-6bd2-4ab6-8ec2-e49386f80014" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7496af56-e7d3-4241-a4c5-1e1444223681]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Created reservations ['cd291e49-c6bc-4861-8952-d514d02357a4', '5aff7b56-a57d-49b3-b4ba-6c8cbf04d478', 'fbe901c7-9f44-47b9-82e7-16505ff9746a', 'b44f0c3d-24ee-41b2-8fcb-de7bc9e0f980'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Delete snapshot completed successfully. Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4d8d352f-45ba-4bb3-96fa-bd6b0d1f7965 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-164d7137-91c1-476b-92b9-b4074aca22d6-delete_snapshot" released by "delete_snapshot" :: held 2.182s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:31 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014 Sep 04 06:16:31 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:31 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-0708e48c-39a7-4606-be2d-6c7c19494d0c" returned: 0 in 0.283s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-quobyte-0708e48c-39a7-4606-be2d-6c7c19494d0c" released by "delete_volume" :: held 0.800s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Created reservations ['1f244453-96ba-45fc-8d67-e0172d4fcc1d', 'a7d14bce-9054-4588-8a03-c64cfb364dbe', '31addc74-0365-4691-9ca7-36eb3a6696d1', '8bc1005d-97ad-4dd5-b563-e284fb3d498f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:31 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:31 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:31 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014" returned: 0 in 0.432s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:31 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014 Sep 04 06:16:31 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:32 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Deleted volume successfully. Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d48acb2f-f139-4b61-8154-5b5cd89bd5cf tempest-VolumeDependencyTests-1046430067 None] Lock "cinder-0708e48c-39a7-4606-be2d-6c7c19494d0c-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:32 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7d932d94-6bd2-4ab6-8ec2-e49386f80014" returned: 0 in 0.332s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Lock "cinder-quobyte-7d932d94-6bd2-4ab6-8ec2-e49386f80014" released by "delete_volume" :: held 0.842s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Created reservations ['06b5bd6a-d9b4-42b2-97c4-ee26d1139930', '406cf4cc-5072-4752-a5ca-537c9cb16048', '3a910cd8-9f27-4fe0-907c-45b148aad182', '54e99fe5-79f4-4251-9fbf-3017ab8a643f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:32 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:32 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-c63befcf-f97e-44cf-9afb-662b8487a693-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-c63befcf-f97e-44cf-9afb-662b8487a693-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "cinder-quobyte-c63befcf-f97e-44cf-9afb-662b8487a693" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-c63befcf-f97e-44cf-9afb-662b8487a693" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df99ff6-8b37-4b12-b068-75eded70dddb]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:32 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Deleted volume successfully. Sep 04 06:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3840fd4-3ad2-4481-8079-f5ebf028f925 tempest-ProjectReaderTests-1269743203 None] Lock "cinder-7d932d94-6bd2-4ab6-8ec2-e49386f80014-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:32 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 Sep 04 06:16:32 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:33 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693" returned: 0 in 0.440s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:33 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693 Sep 04 06:16:33 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:33 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c63befcf-f97e-44cf-9afb-662b8487a693" returned: 0 in 0.294s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-quobyte-c63befcf-f97e-44cf-9afb-662b8487a693" released by "delete_volume" :: held 0.857s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:33 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Created reservations ['d1f24e26-479f-464f-a2e7-1424d4c7d957', '8913f3ce-661e-40cf-841a-0481b776d7a7', '0ccbb75b-4a91-4964-9ff0-75f0c4cdf088', 'a5ad7d0b-ff5b-44da-a567-4f4eff940534'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:33 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:33 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:34 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.536s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:34 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Deleted volume successfully. Sep 04 06:16:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8303188c-cc58-4cde-969f-f49487d11640 tempest-CreateVolumesFromSnapshotTest-322726328 None] Lock "cinder-c63befcf-f97e-44cf-9afb-662b8487a693-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Flow 'volume_create_manager' (7a988e07-009f-43ea-8658-f98c0911cf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212deb84-cc5c-4711-af59-a3af4bb68f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212deb84-cc5c-4711-af59-a3af4bb68f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-112730544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dca4da6-b056-4a4b-a8d6-956d2746b103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c779d2d53f4ad49402f7686a6b187b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:40Z,use_quota=True,user_id='f234eb0eb3d94c9d9acec1b207738a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4efa7c-d98d-4b99-9351-77b237913db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4efa7c-d98d-4b99-9351-77b237913db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2430d88-d5cc-495b-8a0a-dd0ce98fc121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2430d88-d5cc-495b-8a0a-dd0ce98fc121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dca4da6-b056-4a4b-a8d6-956d2746b103', 'volume_name': 'volume-8dca4da6-b056-4a4b-a8d6-956d2746b103', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb71bac2-cac4-4613-bfb6-ba7c96c29fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb71bac2-cac4-4613-bfb6-ba7c96c29fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acb6f89-6e4c-4d71-bb85-58c57ee40f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume 8dca4da6-b056-4a4b-a8d6-956d2746b103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dca4da6-b056-4a4b-a8d6-956d2746b103', 'volume_size': 1} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-112730544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dca4da6-b056-4a4b-a8d6-956d2746b103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c779d2d53f4ad49402f7686a6b187b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:40Z,use_quota=True,user_id='f234eb0eb3d94c9d9acec1b207738a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Creating volume 8dca4da6-b056-4a4b-a8d6-956d2746b103 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:39 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dca4da6-b056-4a4b-a8d6-956d2746b103 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:39 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dca4da6-b056-4a4b-a8d6-956d2746b103 1073741824 Sep 04 06:16:39 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:40 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dca4da6-b056-4a4b-a8d6-956d2746b103 1073741824" returned: 0 in 0.627s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dca4da6-b056-4a4b-a8d6-956d2746b103 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:40 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dca4da6-b056-4a4b-a8d6-956d2746b103 Sep 04 06:16:40 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:40 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dca4da6-b056-4a4b-a8d6-956d2746b103" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=244,cinder:SELECT=181,cinder:DELETE=23,cinder:INSERT=63 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:16:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acb6f89-6e4c-4d71-bb85-58c57ee40f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dca4da6-b056-4a4b-a8d6-956d2746b103', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51173d13-390d-424c-91ff-0663a2639922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume volume-8dca4da6-b056-4a4b-a8d6-956d2746b103 (8dca4da6-b056-4a4b-a8d6-956d2746b103): created successfully Sep 04 06:16:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51173d13-390d-424c-91ff-0663a2639922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Flow 'volume_create_manager' (7a988e07-009f-43ea-8658-f98c0911cf1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3a2e867e-cfd9-40ab-ac70-7d67e7c327e4 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Created volume successfully. Sep 04 06:16:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=170,cinder:UPDATE=229,cinder:INSERT=67,cinder:DELETE=19 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Flow 'volume_create_manager' (5841178c-aa7a-4f40-85d0-901480800852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407e3614-f92e-4067-a920-3a8ffd575c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407e3614-f92e-4067-a920-3a8ffd575c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-131612136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9f3934-ea60-4aa8-8778-f7da07e3a8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c779d2d53f4ad49402f7686a6b187b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:42Z,use_quota=True,user_id='f234eb0eb3d94c9d9acec1b207738a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c602d2-e93b-4f48-893b-ae0875da118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c602d2-e93b-4f48-893b-ae0875da118d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260e9b75-3190-44b7-8060-74540b222492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260e9b75-3190-44b7-8060-74540b222492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9f3934-ea60-4aa8-8778-f7da07e3a8ce', 'volume_name': 'volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (651f6598-6853-43c0-810d-4f25385b2b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (651f6598-6853-43c0-810d-4f25385b2b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5a96a7-f8d3-4779-91cd-6a919f42ed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume 6d9f3934-ea60-4aa8-8778-f7da07e3a8ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce', 'volume_size': 1} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-131612136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9f3934-ea60-4aa8-8778-f7da07e3a8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c779d2d53f4ad49402f7686a6b187b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:42Z,use_quota=True,user_id='f234eb0eb3d94c9d9acec1b207738a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Creating volume 6d9f3934-ea60-4aa8-8778-f7da07e3a8ce {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:42 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:42 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce 1073741824 Sep 04 06:16:42 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Flow 'volume_create_manager' (a60093a2-c3cb-446a-97ff-9cfc581b2e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea95cdc-d591-45e8-94b3-b5abaf59c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea95cdc-d591-45e8-94b3-b5abaf59c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-305983913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb4d2a1-aa4d-4dd5-b703-47e680427c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c779d2d53f4ad49402f7686a6b187b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:43Z,use_quota=True,user_id='f234eb0eb3d94c9d9acec1b207738a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7def0c36-7754-4f98-9bd4-71ec2d8575b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7def0c36-7754-4f98-9bd4-71ec2d8575b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8023b046-42df-4403-8d43-8f989886c669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8023b046-42df-4403-8d43-8f989886c669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb4d2a1-aa4d-4dd5-b703-47e680427c93', 'volume_name': 'volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1118ae7e-1382-416f-97b0-ccb8138b9d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1118ae7e-1382-416f-97b0-ccb8138b9d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646e676c-25f2-4174-b2ca-e4e33877d2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume 8fb4d2a1-aa4d-4dd5-b703-47e680427c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93', 'volume_size': 1} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:43 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce 1073741824" returned: 0 in 0.799s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:43 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce Sep 04 06:16:43 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Flow 'volume_create_manager' (dfcf0a60-158c-49d9-8432-ab325001a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3253cf45-7508-4dd3-97a4-08f15e0f4644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3253cf45-7508-4dd3-97a4-08f15e0f4644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1038695940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2044bce69dc849a29a5f7ddb499ca7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:44Z,use_quota=True,user_id='ab8e2d8b41c047fdbf1629d1d8e89fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bb4e6b-17d7-4bf3-a4d5-f74116b64ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bb4e6b-17d7-4bf3-a4d5-f74116b64ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb817b4-7b25-4e52-bdd0-4975ffb99378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:43 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb817b4-7b25-4e52-bdd0-4975ffb99378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d', 'volume_name': 'volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9920f6cb-3395-447f-8446-a9a50e6f26b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9920f6cb-3395-447f-8446-a9a50e6f26b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c6d287-9d34-4320-a98e-b1299fa009ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Volume 5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d', 'volume_size': 1} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce" returned: 0 in 0.417s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-305983913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb4d2a1-aa4d-4dd5-b703-47e680427c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c779d2d53f4ad49402f7686a6b187b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:43Z,use_quota=True,user_id='f234eb0eb3d94c9d9acec1b207738a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Creating volume 8fb4d2a1-aa4d-4dd5-b703-47e680427c93 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:43 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:43 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93 1073741824 Sep 04 06:16:43 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Flow 'volume_create_manager' (ba812a53-3906-4185-ab8f-67857cc38cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a3073b-78e9-4845-830b-fc4213dbf006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5a96a7-f8d3-4779-91cd-6a919f42ed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880c7458-bcf3-4714-86af-e29c10806b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a3073b-78e9-4845-830b-fc4213dbf006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1485865532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18cd3c66-cbef-44f4-8829-1bfb156c1429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c779d2d53f4ad49402f7686a6b187b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:44Z,use_quota=True,user_id='f234eb0eb3d94c9d9acec1b207738a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8ab1f5-7f77-4786-b84a-6b70ee9a4fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8ab1f5-7f77-4786-b84a-6b70ee9a4fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9bfd3b-f2b3-4a05-8560-127ff97fc9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9bfd3b-f2b3-4a05-8560-127ff97fc9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18cd3c66-cbef-44f4-8829-1bfb156c1429', 'volume_name': 'volume-18cd3c66-cbef-44f4-8829-1bfb156c1429', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b7479b-75e2-4364-ac58-a4a504e21c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b7479b-75e2-4364-ac58-a4a504e21c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71209692-e264-45c4-9c1c-a7e8dea641e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume 18cd3c66-cbef-44f4-8829-1bfb156c1429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18cd3c66-cbef-44f4-8829-1bfb156c1429', 'volume_size': 1} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce (6d9f3934-ea60-4aa8-8778-f7da07e3a8ce): created successfully Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880c7458-bcf3-4714-86af-e29c10806b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Flow 'volume_create_manager' (5841178c-aa7a-4f40-85d0-901480800852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0b467c8f-a1f9-4e3c-be36-42ff410bcefd tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Created volume successfully. Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Flow 'volume_create_manager' (202862cc-f48e-49a1-8dd9-32ad9737d48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120f9378-b65c-4983-b730-0dc5d1ab994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120f9378-b65c-4983-b730-0dc5d1ab994b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-287023742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084db54e-4091-4902-b2e6-804772958e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c779d2d53f4ad49402f7686a6b187b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:44Z,use_quota=True,user_id='f234eb0eb3d94c9d9acec1b207738a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d53a21-45ca-4c57-94e7-a8674051e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d53a21-45ca-4c57-94e7-a8674051e59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b17387-a13e-46f3-a731-aa7ffb7f9583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b17387-a13e-46f3-a731-aa7ffb7f9583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084db54e-4091-4902-b2e6-804772958e06', 'volume_name': 'volume-084db54e-4091-4902-b2e6-804772958e06', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb9e3b2-cdf5-4823-9e89-2a830ff497c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb9e3b2-cdf5-4823-9e89-2a830ff497c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc01bb0c-6474-4841-a103-399fb12c78f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume 084db54e-4091-4902-b2e6-804772958e06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084db54e-4091-4902-b2e6-804772958e06', 'volume_size': 1} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:44 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93 1073741824" returned: 0 in 0.678s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:44 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93 Sep 04 06:16:44 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:44 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93" returned: 0 in 0.274s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1038695940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2044bce69dc849a29a5f7ddb499ca7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:44Z,use_quota=True,user_id='ab8e2d8b41c047fdbf1629d1d8e89fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Creating volume 5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:44 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646e676c-25f2-4174-b2ca-e4e33877d2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0064b01f-dc12-4c56-a595-2ecfa1f583fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:44 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d 1073741824 Sep 04 06:16:44 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Flow 'volume_create_manager' (4348fdc8-32c5-41bf-b4f7-2eb19dc67567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652d7a38-e660-4840-98a9-b4231efee875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93 (8fb4d2a1-aa4d-4dd5-b703-47e680427c93): created successfully Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0064b01f-dc12-4c56-a595-2ecfa1f583fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Flow 'volume_create_manager' (a60093a2-c3cb-446a-97ff-9cfc581b2e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652d7a38-e660-4840-98a9-b4231efee875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2060770077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5611ae81-fba0-4d3a-bac7-7f6a6f125881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c779d2d53f4ad49402f7686a6b187b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:45Z,use_quota=True,user_id='f234eb0eb3d94c9d9acec1b207738a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f3ae50-0744-4345-a807-e0553452540c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f3ae50-0744-4345-a807-e0553452540c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b3d1a3-4883-41a3-adf6-30e559da35e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b3d1a3-4883-41a3-adf6-30e559da35e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5611ae81-fba0-4d3a-bac7-7f6a6f125881', 'volume_name': 'volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41ee3c0-536c-4ca9-81a0-239926d2c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41ee3c0-536c-4ca9-81a0-239926d2c445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bed0358-aad6-4730-a43a-08836ef1805c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume 5611ae81-fba0-4d3a-bac7-7f6a6f125881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881', 'volume_size': 1} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Flow 'volume_create_manager' (1368a9c6-7dda-434e-a34d-2b5586493314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3127860e-e5ee-4acb-a0e2-301224582ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1cad427f-90d3-4fd3-a9d0-727d8d042ac9 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Created volume successfully. Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3127860e-e5ee-4acb-a0e2-301224582ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-578360825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7cc61d1ebd4ef3b56969bfa539e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:45Z,use_quota=True,user_id='40276a0e3b7e4319809df5e2af8493f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4b73b4-6a35-4d8e-a66e-0ef85aa5815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4b73b4-6a35-4d8e-a66e-0ef85aa5815a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da6efd0-a759-46fe-98a2-d3e9320c7db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da6efd0-a759-46fe-98a2-d3e9320c7db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48', 'volume_name': 'volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fab022d-2fe5-41a6-aa42-a8f7f51a4ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fab022d-2fe5-41a6-aa42-a8f7f51a4ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56aea01b-2537-4bfa-ac74-7caeabbbf62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Volume b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48', 'volume_size': 1} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:45 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d 1073741824" returned: 0 in 0.492s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:45 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d Sep 04 06:16:45 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:45 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1485865532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18cd3c66-cbef-44f4-8829-1bfb156c1429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c779d2d53f4ad49402f7686a6b187b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:44Z,use_quota=True,user_id='f234eb0eb3d94c9d9acec1b207738a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Creating volume 18cd3c66-cbef-44f4-8829-1bfb156c1429 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:45 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18cd3c66-cbef-44f4-8829-1bfb156c1429 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:45 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18cd3c66-cbef-44f4-8829-1bfb156c1429 1073741824 Sep 04 06:16:45 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c6d287-9d34-4320-a98e-b1299fa009ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762b7141-5e34-4ad5-afe5-798de7f77ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Volume volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d (5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d): created successfully Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762b7141-5e34-4ad5-afe5-798de7f77ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Flow 'volume_create_manager' (dfcf0a60-158c-49d9-8432-ab325001a973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-35f1cbdb-827b-4cd6-abea-1810d017bd0a tempest-SnapshotDependencyTests-1992107649 None] Created volume successfully. Sep 04 06:16:46 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18cd3c66-cbef-44f4-8829-1bfb156c1429 1073741824" returned: 0 in 0.446s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18cd3c66-cbef-44f4-8829-1bfb156c1429 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:46 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18cd3c66-cbef-44f4-8829-1bfb156c1429 Sep 04 06:16:46 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:46 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18cd3c66-cbef-44f4-8829-1bfb156c1429" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.107s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-287023742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084db54e-4091-4902-b2e6-804772958e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c779d2d53f4ad49402f7686a6b187b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:44Z,use_quota=True,user_id='f234eb0eb3d94c9d9acec1b207738a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Creating volume 084db54e-4091-4902-b2e6-804772958e06 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:46 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-084db54e-4091-4902-b2e6-804772958e06 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71209692-e264-45c4-9c1c-a7e8dea641e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18cd3c66-cbef-44f4-8829-1bfb156c1429', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:46 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-084db54e-4091-4902-b2e6-804772958e06 1073741824 Sep 04 06:16:46 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473bcf21-0da1-4964-b4b8-2b2549d86e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:46 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume volume-18cd3c66-cbef-44f4-8829-1bfb156c1429 (18cd3c66-cbef-44f4-8829-1bfb156c1429): created successfully Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473bcf21-0da1-4964-b4b8-2b2549d86e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Flow 'volume_create_manager' (ba812a53-3906-4185-ab8f-67857cc38cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-49a07a57-1925-42f8-9e19-1647b6af8b05 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Created volume successfully. Sep 04 06:16:47 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-084db54e-4091-4902-b2e6-804772958e06 1073741824" returned: 0 in 0.596s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-084db54e-4091-4902-b2e6-804772958e06 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:47 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-084db54e-4091-4902-b2e6-804772958e06 Sep 04 06:16:47 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Flow 'volume_create_manager' (1b1e333b-3804-42e7-9c8c-f7fe22285bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc08440-4399-4f44-a2b1-7be5b7c94c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc08440-4399-4f44-a2b1-7be5b7c94c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-61111625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a5bc32-f0d8-479a-8f40-a3d6f838f0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658ae962fc174a9f9188506e28b71f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:47Z,use_quota=True,user_id='2fcc8453faf64632ae8857594e88426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3cc0f46-3a6b-4774-ad18-d5846e6b00a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3cc0f46-3a6b-4774-ad18-d5846e6b00a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7e4f3b-efa5-4986-bb5c-0f87b8c4cf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7e4f3b-efa5-4986-bb5c-0f87b8c4cf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97a5bc32-f0d8-479a-8f40-a3d6f838f0c6', 'volume_name': 'volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d82e65b-c6d4-4d41-aab4-8821c8949ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d82e65b-c6d4-4d41-aab4-8821c8949ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3caf1a13-2348-4906-bf65-9878c32b3f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Volume 97a5bc32-f0d8-479a-8f40-a3d6f838f0c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6', 'volume_size': 1} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:47 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-084db54e-4091-4902-b2e6-804772958e06" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.300s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2060770077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5611ae81-fba0-4d3a-bac7-7f6a6f125881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c779d2d53f4ad49402f7686a6b187b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:45Z,use_quota=True,user_id='f234eb0eb3d94c9d9acec1b207738a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Creating volume 5611ae81-fba0-4d3a-bac7-7f6a6f125881 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:47 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc01bb0c-6474-4841-a103-399fb12c78f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084db54e-4091-4902-b2e6-804772958e06', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:47 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881 1073741824 Sep 04 06:16:47 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75384a86-991b-4e5a-a6d9-1eb749fe0178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume volume-084db54e-4091-4902-b2e6-804772958e06 (084db54e-4091-4902-b2e6-804772958e06): created successfully Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75384a86-991b-4e5a-a6d9-1eb749fe0178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Flow 'volume_create_manager' (202862cc-f48e-49a1-8dd9-32ad9737d48e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dab6f2dc-afe2-4917-a7fb-39dbc31e6a0b tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Created volume successfully. Sep 04 06:16:47 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881 1073741824" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:47 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881 Sep 04 06:16:47 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:48 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.910s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-578360825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7cc61d1ebd4ef3b56969bfa539e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:45Z,use_quota=True,user_id='40276a0e3b7e4319809df5e2af8493f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Creating volume b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:48 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bed0358-aad6-4730-a43a-08836ef1805c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:48 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 1073741824 Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf3b2f4-2f5c-48f2-b681-ee827ccd6bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:48 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Volume volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881 (5611ae81-fba0-4d3a-bac7-7f6a6f125881): created successfully Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf3b2f4-2f5c-48f2-b681-ee827ccd6bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Flow 'volume_create_manager' (4348fdc8-32c5-41bf-b4f7-2eb19dc67567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1d505dc2-3c14-4128-b67a-d1ab2ca6eacb tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Created volume successfully. Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "cinder-5611ae81-fba0-4d3a-bac7-7f6a6f125881-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-5611ae81-fba0-4d3a-bac7-7f6a6f125881-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "cinder-quobyte-5611ae81-fba0-4d3a-bac7-7f6a6f125881" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-quobyte-5611ae81-fba0-4d3a-bac7-7f6a6f125881" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[971062c4-f416-4215-86a2-ba13447a293d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:48 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881 Sep 04 06:16:48 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:48 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 1073741824" returned: 0 in 0.449s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:48 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 Sep 04 06:16:48 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:48 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:48 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881 Sep 04 06:16:48 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:48 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48" returned: 0 in 0.294s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.632s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56aea01b-2537-4bfa-ac74-7caeabbbf62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa391d2-1c2c-4b4e-9393-f45315d221ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] Creating offline snapshot 69c5f741-e200-4896-9731-764b76d7b549 of volume 5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:16:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Volume volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 (b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48): created successfully Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa391d2-1c2c-4b4e-9393-f45315d221ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Flow 'volume_create_manager' (1368a9c6-7dda-434e-a34d-2b5586493314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0ba282-8ded-425c-b856-b35fa10432d9]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-76ab3f49-7814-4239-90fc-0cdaa1f1fd1a tempest-ProjectReaderTests-1022205293 None] Created volume successfully. Sep 04 06:16:49 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5611ae81-fba0-4d3a-bac7-7f6a6f125881" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-quobyte-5611ae81-fba0-4d3a-bac7-7f6a6f125881" released by "delete_volume" :: held 0.667s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:49 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d Sep 04 06:16:49 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Created reservations ['bb2aeebb-d819-44f4-b2c6-f25d51c22636', '3a63d9c9-45ac-4f54-9d60-e7a85bb33ae9', 'd3441eaa-f46b-454e-9246-21e8a0a0a8e1', 'c4a90444-c8d8-4de8-b7c1-c09dfb3fbbe0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:49 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:49 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:49 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d" returned: 0 in 0.425s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:49 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 1G Sep 04 06:16:49 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:49 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Deleted volume successfully. Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-57ae85ad-19da-4974-b669-33d30ebbc538 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-5611ae81-fba0-4d3a-bac7-7f6a6f125881-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "cinder-084db54e-4091-4902-b2e6-804772958e06-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-084db54e-4091-4902-b2e6-804772958e06-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "cinder-quobyte-084db54e-4091-4902-b2e6-804772958e06" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-quobyte-084db54e-4091-4902-b2e6-804772958e06" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0890d56-e1f8-4ad9-ac17-381039ad0de9]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-084db54e-4091-4902-b2e6-804772958e06 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:49 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-084db54e-4091-4902-b2e6-804772958e06 Sep 04 06:16:49 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:49 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 1G" returned: 0 in 0.421s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:49 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 Sep 04 06:16:49 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:49 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-084db54e-4091-4902-b2e6-804772958e06" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-084db54e-4091-4902-b2e6-804772958e06 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:50 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-084db54e-4091-4902-b2e6-804772958e06 Sep 04 06:16:50 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:50 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:50 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 is being set with open permissions: ugo+rw Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:50 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 Sep 04 06:16:50 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:50 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-084db54e-4091-4902-b2e6-804772958e06" returned: 0 in 0.310s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-quobyte-084db54e-4091-4902-b2e6-804772958e06" released by "delete_volume" :: held 0.753s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Created reservations ['9a2bf98d-9eee-49f1-b45c-d8a7e8e68c3f', '5775af06-fe51-4392-bf8e-70fb1957ff4e', '337dd230-81c5-4528-9ad7-4eb44bd4a35b', '471a97a6-2b1b-4736-b8b3-099a50a5b47d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:50 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549" returned: 0 in 0.283s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:50 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:50 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:50 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.info Sep 04 06:16:50 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:50 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "cinder-18cd3c66-cbef-44f4-8829-1bfb156c1429-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Deleted volume successfully. Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-18cd3c66-cbef-44f4-8829-1bfb156c1429-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b236cdc-41cc-46ae-87e2-86e495142446 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-084db54e-4091-4902-b2e6-804772958e06-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "cinder-quobyte-18cd3c66-cbef-44f4-8829-1bfb156c1429" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:50 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-quobyte-18cd3c66-cbef-44f4-8829-1bfb156c1429" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.info" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:50 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.info is being set with open permissions: ugo+rw Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa639b61-96a6-43bf-bb28-ee213e2b48b2]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18cd3c66-cbef-44f4-8829-1bfb156c1429 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:50 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.info Sep 04 06:16:50 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:50 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18cd3c66-cbef-44f4-8829-1bfb156c1429 Sep 04 06:16:50 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:51 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.info" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.182s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.728s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-61111625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a5bc32-f0d8-479a-8f40-a3d6f838f0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658ae962fc174a9f9188506e28b71f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:47Z,use_quota=True,user_id='2fcc8453faf64632ae8857594e88426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Creating volume 97a5bc32-f0d8-479a-8f40-a3d6f838f0c6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:51 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:51 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6 1073741824 Sep 04 06:16:51 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b81487fc-2290-4e79-b8ec-f72ac9fc36df tempest-SnapshotDependencyTests-1992107649 None] Create snapshot completed successfully Sep 04 06:16:51 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18cd3c66-cbef-44f4-8829-1bfb156c1429" returned: 0 in 0.430s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18cd3c66-cbef-44f4-8829-1bfb156c1429 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:51 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18cd3c66-cbef-44f4-8829-1bfb156c1429 Sep 04 06:16:51 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:51 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-18cd3c66-cbef-44f4-8829-1bfb156c1429" returned: 0 in 0.289s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-quobyte-18cd3c66-cbef-44f4-8829-1bfb156c1429" released by "delete_volume" :: held 0.762s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Created reservations ['2fbc92c0-bb13-472c-b4af-996f65b9cae2', 'a308726e-9560-447c-8e6b-9aacc326ad8c', '34662d3c-d7ae-4901-ae69-1c08dfab1b45', '5602a049-77d7-43dd-aafa-d9c46ca56cb9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:51 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6 1073741824" returned: 0 in 0.514s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:51 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6 Sep 04 06:16:51 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:51 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:51 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "cinder-8fb4d2a1-aa4d-4dd5-b703-47e680427c93-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-8fb4d2a1-aa4d-4dd5-b703-47e680427c93-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:51 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6" returned: 0 in 0.301s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.712s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:52 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "cinder-quobyte-8fb4d2a1-aa4d-4dd5-b703-47e680427c93" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3caf1a13-2348-4906-bf65-9878c32b3f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f239cb-8959-4b15-8990-3d78b8bfb0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] Creating offline snapshot 2411bcef-eec3-4192-8bf9-961e4d9bba1b of volume b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:16:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Deleted volume successfully. Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0f7348-f9e7-4ff8-8db9-5bfb8608a689]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:52 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Volume volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6 (97a5bc32-f0d8-479a-8f40-a3d6f838f0c6): created successfully Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f239cb-8959-4b15-8990-3d78b8bfb0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Flow 'volume_create_manager' (1b1e333b-3804-42e7-9c8c-f7fe22285bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-quobyte-8fb4d2a1-aa4d-4dd5-b703-47e680427c93" acquired by "delete_volume" :: waited 0.081s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[707c6898-724e-4725-ba11-fea43c687d4c]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-36248978-26b4-4f24-9148-75087eda7e9e tempest-ProjectReaderTests-1809164788 None] Created volume successfully. Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-535aacd1-00e6-4f59-ac07-acdd15eeb74d tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-18cd3c66-cbef-44f4-8829-1bfb156c1429-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Flow 'volume_create_manager' (b52c75cc-f1d0-4568-8247-f3507385e4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:52 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 Sep 04 06:16:52 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18c7d31-cda7-4766-8003-74458b5fa686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18c7d31-cda7-4766-8003-74458b5fa686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9871b2d0-7f31-4118-b753-461a4979d4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2044bce69dc849a29a5f7ddb499ca7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=69c5f741-e200-4896-9731-764b76d7b549,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:52Z,use_quota=True,user_id='ab8e2d8b41c047fdbf1629d1d8e89fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13f8add-f6af-4b8a-a393-b40735e9d082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13f8add-f6af-4b8a-a393-b40735e9d082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7104553d-de49-4d8a-98f9-cf48292a76c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:52 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93 Sep 04 06:16:52 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7104553d-de49-4d8a-98f9-cf48292a76c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9871b2d0-7f31-4118-b753-461a4979d4a9', 'volume_name': 'volume-9871b2d0-7f31-4118-b753-461a4979d4a9', 'volume_size': 1, 'snapshot_id': '69c5f741-e200-4896-9731-764b76d7b549'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e0dcd4-5c3b-4bfe-81e2-e764fd36c5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e0dcd4-5c3b-4bfe-81e2-e764fd36c5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcd4b98-4d42-4a83-b186-d450adccbabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:52 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Volume 9871b2d0-7f31-4118-b753-461a4979d4a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9871b2d0-7f31-4118-b753-461a4979d4a9', 'volume_size': 1, 'snapshot_id': '69c5f741-e200-4896-9731-764b76d7b549'} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:52 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48" returned: 0 in 0.397s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:52 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b 1G Sep 04 06:16:52 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:52 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93" returned: 0 in 0.384s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:52 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93 Sep 04 06:16:52 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "cinder-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Lock "cinder-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "cinder-quobyte-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Lock "cinder-quobyte-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2777b9bb-8ccc-4f4d-ad75-c30a748c1bf1]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:52 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8fb4d2a1-aa4d-4dd5-b703-47e680427c93" returned: 0 in 0.337s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-quobyte-8fb4d2a1-aa4d-4dd5-b703-47e680427c93" released by "delete_volume" :: held 0.771s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:52 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6 Sep 04 06:16:52 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:52 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b 1G" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:53 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Created reservations ['06c64628-3e06-43e0-8767-8824443f0c86', '2c71ad1e-fc6d-4b3a-8a4b-3dba34106c89', '8f653d4e-a573-4c81-97be-097b5b123e34', 'b6c4a2d7-bca6-45a6-9139-98697c06b976'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:53 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:53 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:53 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:53 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6" returned: 0 in 0.424s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:53 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6 Sep 04 06:16:53 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:53 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b" returned: 0 in 0.330s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:53 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b is being set with open permissions: ugo+rw Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:53 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b Sep 04 06:16:53 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:53 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Deleted volume successfully. Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3b210fd-7d0d-4ae3-bb3b-dac27e886747 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-8fb4d2a1-aa4d-4dd5-b703-47e680427c93-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:53 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Lock "cinder-quobyte-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6" released by "delete_volume" :: held 0.732s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Created reservations ['30fc2791-b52f-43ba-ad09-ac034b7315b5', '48e669f2-6f4e-4095-91b8-5c66188200e6', '4cdd739d-c389-4ebf-9e24-3dea1892a3ec', 'eb874eb1-cdc1-4310-be98-36ded3870944'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:53 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b" returned: 0 in 0.264s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:53 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.info Sep 04 06:16:53 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:53 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:53 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:53 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.info" returned: 0 in 0.269s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:53 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.info is being set with open permissions: ugo+rw Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:53 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.info Sep 04 06:16:53 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:53 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Deleted volume successfully. Sep 04 06:16:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c09b58b4-b1f0-4510-9e5f-08ba315d8fc4 tempest-ProjectReaderTests-1809164788 None] Lock "cinder-97a5bc32-f0d8-479a-8f40-a3d6f838f0c6-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:54 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.info" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.866s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "cinder-quobyte-69c5f741-e200-4896-9731-764b76d7b549-9871b2d0-7f31-4118-b753-461a4979d4a9" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "cinder-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ff72dc45-b447-4a98-9db2-a0ea64138ad8 tempest-ProjectReaderTests-1022205293 None] Create snapshot completed successfully Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-quobyte-69c5f741-e200-4896-9731-764b76d7b549-9871b2d0-7f31-4118-b753-461a4979d4a9" acquired by "_create_volume_from_snapshot" :: waited 0.061s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Creating volume 9871b2d0-7f31-4118-b753-461a4979d4a9 from snapshot 69c5f741-e200-4896-9731-764b76d7b549 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "cinder-quobyte-9871b2d0-7f31-4118-b753-461a4979d4a9" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-quobyte-9871b2d0-7f31-4118-b753-461a4979d4a9" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] snapshot: 69c5f741-e200-4896-9731-764b76d7b549, volume: 9871b2d0-7f31-4118-b753-461a4979d4a9, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "cinder-quobyte-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f00e0-905b-4d34-8ed0-be2515a20a2c]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-quobyte-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d86957f-f465-4b0f-8b94-3a472cae1d65]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:16:54 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 Sep 04 06:16:54 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Flow 'volume_create_manager' (cd1b1a15-71ff-40cd-8773-7499f3cbf946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e00ba6-c25c-4324-ba95-bd0e26af8f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e00ba6-c25c-4324-ba95-bd0e26af8f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1741680707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e93a5c-a330-4bad-b3b0-f215232a3e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658ae962fc174a9f9188506e28b71f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:54Z,use_quota=True,user_id='2fcc8453faf64632ae8857594e88426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:54 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce Sep 04 06:16:54 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90c4b56-28cf-4326-b581-88cdbcfce4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90c4b56-28cf-4326-b581-88cdbcfce4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbee2f8-7fd7-4844-a822-d4cc352dee43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbee2f8-7fd7-4844-a822-d4cc352dee43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e93a5c-a330-4bad-b3b0-f215232a3e22', 'volume_name': 'volume-65e93a5c-a330-4bad-b3b0-f215232a3e22', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab277ae0-347f-4398-8f6d-3fc450ec6513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab277ae0-347f-4398-8f6d-3fc450ec6513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4dab3dd-74fa-440f-8096-f0f6c5d0f9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:16:54 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Volume 65e93a5c-a330-4bad-b3b0-f215232a3e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e93a5c-a330-4bad-b3b0-f215232a3e22', 'volume_size': 1} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-2411bcef-eec3-4192-8bf9-961e4d9bba1b-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-2411bcef-eec3-4192-8bf9-961e4d9bba1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-2411bcef-eec3-4192-8bf9-961e4d9bba1b" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-2411bcef-eec3-4192-8bf9-961e4d9bba1b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Deleting offline snapshot 2411bcef-eec3-4192-8bf9-961e4d9bba1b of volume b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] snapshot_file for this snap is: volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c6ff69-1174-4d23-9409-ddfc20a2aeec]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:54 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549" returned: 0 in 0.428s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b419eb83-80fb-4333-9b3b-b4f14b23b42d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:54 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce" returned: 0 in 0.403s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:54 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce Sep 04 06:16:54 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:54 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b Sep 04 06:16:54 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:54 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d Sep 04 06:16:54 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:55 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce" returned: 0 in 0.284s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-quobyte-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce" released by "delete_volume" :: held 0.744s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:55 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf8745b-b4e2-4e6b-870d-e6c758b50663]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:55 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] will copy from snapshot at /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Path /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:55 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9 Sep 04 06:16:55 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Created reservations ['0dba1c39-0e8e-479a-9187-9f60ce516daa', 'b34681cd-b33c-4977-b285-1884f8bf28a5', '586d6a13-2ed7-4c94-b5cb-0481d95f43ed', '3ba524aa-17f2-4d67-b8b9-5b820d054442'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:55 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 Sep 04 06:16:55 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:55 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:55 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "cinder-8dca4da6-b056-4a4b-a8d6-956d2746b103-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-8dca4da6-b056-4a4b-a8d6-956d2746b103-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "cinder-quobyte-8dca4da6-b056-4a4b-a8d6-956d2746b103" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-quobyte-8dca4da6-b056-4a4b-a8d6-956d2746b103" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[259db912-6422-409e-b046-ecccb394f284]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dca4da6-b056-4a4b-a8d6-956d2746b103 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:55 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48" returned: 0 in 0.439s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:55 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:55 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b Sep 04 06:16:55 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Deleted volume successfully. Sep 04 06:16:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95d370c7-a352-4dcd-96eb-60a200b01fb0 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-6d9f3934-ea60-4aa8-8778-f7da07e3a8ce-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:55 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dca4da6-b056-4a4b-a8d6-956d2746b103 Sep 04 06:16:55 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:56 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b" returned: 0 in 0.628s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:56 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b Sep 04 06:16:56 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:56 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dca4da6-b056-4a4b-a8d6-956d2746b103" returned: 0 in 0.740s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dca4da6-b056-4a4b-a8d6-956d2746b103 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:56 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dca4da6-b056-4a4b-a8d6-956d2746b103 Sep 04 06:16:56 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:56 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48.2411bcef-eec3-4192-8bf9-961e4d9bba1b" returned: 0 in 0.656s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:56 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8dca4da6-b056-4a4b-a8d6-956d2746b103" returned: 0 in 0.668s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-2411bcef-eec3-4192-8bf9-961e4d9bba1b" released by "_delete_snapshot" :: held 2.283s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-quobyte-8dca4da6-b056-4a4b-a8d6-956d2746b103" released by "delete_volume" :: held 1.480s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48" released by "delete_snapshot" :: held 2.332s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Created reservations ['a0b61a7b-3bc5-40d0-addc-8d73752304d1', '69e158ce-8b4b-4c45-9efb-9b28a33fd0a9', '03389a50-af9a-44a9-bea6-7da864448ea7', 'c1465d56-b384-4a02-b689-e42ff5621bde'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Created reservations ['4f6bf506-e655-4ca8-b461-93f751db3c5a', 'beb514e3-1d97-4a59-9e13-3e158e072f41', '96e54a58-93a8-45af-bfca-c2827e79c7b7', '110754ff-9349-4296-a807-247d413f93dc'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:16:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:16:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:16:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:16:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:16:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:16:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:57 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:16:57 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Delete snapshot completed successfully. Sep 04 06:16:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8628b0e-0a7b-4c74-87ac-7f9566327112 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-2411bcef-eec3-4192-8bf9-961e4d9bba1b-delete_snapshot" released by "delete_snapshot" :: held 2.997s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:58 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.778s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:58 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:16:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Deleted volume successfully. Sep 04 06:16:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede1fa82-9592-47ad-88fe-52523f5a6d19 tempest-CreateVolumesFromSourceVolumeTest-2025307270 None] Lock "cinder-8dca4da6-b056-4a4b-a8d6-956d2746b103-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:16:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:16:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:16:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[92745139-7a53-4c01-9f45-191f91a953ea]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:16:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:58 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 Sep 04 06:16:58 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:16:59 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 04 06:16:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48" returned: 0 in 1.172s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:16:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:16:59 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48 Sep 04 06:16:59 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:00 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48" returned: 0 in 0.730s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:00 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9" returned: 0 in 5.314s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Image conversion details: src /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 06:17:00 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Converted 1024.00 MB image at 192.66 MB/s Sep 04 06:17:00 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9 is being set with open permissions: ugo+rw Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48" released by "delete_volume" :: held 2.056s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:00 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9 Sep 04 06:17:00 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Created reservations ['90aff02d-2e00-4c42-92ee-784d737aecbc', '750503c8-fc8b-49cc-b2a8-b2df70eccb16', 'fb6ce111-8d59-4aed-8e2a-2283cd249998', '68e97419-0313-4398-9c3e-f4817045a626'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:00 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:00 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:00 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-quobyte-9871b2d0-7f31-4118-b753-461a4979d4a9" released by "_copy_volume_from_snapshot" :: held 6.525s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-quobyte-69c5f741-e200-4896-9731-764b76d7b549-9871b2d0-7f31-4118-b753-461a4979d4a9" released by "_create_volume_from_snapshot" :: held 6.641s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.704s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.336s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1741680707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e93a5c-a330-4bad-b3b0-f215232a3e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658ae962fc174a9f9188506e28b71f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:16:54Z,use_quota=True,user_id='2fcc8453faf64632ae8857594e88426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Creating volume 65e93a5c-a330-4bad-b3b0-f215232a3e22 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:00 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-65e93a5c-a330-4bad-b3b0-f215232a3e22 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:00 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-65e93a5c-a330-4bad-b3b0-f215232a3e22 1073741824 Sep 04 06:17:00 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:01 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcd4b98-4d42-4a83-b186-d450adccbabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9871b2d0-7f31-4118-b753-461a4979d4a9', 'volume_size': 1, 'snapshot_id': '69c5f741-e200-4896-9731-764b76d7b549'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283594c1-bb3f-4904-8adb-73b438b003b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Deleted volume successfully. Sep 04 06:17:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Volume volume-9871b2d0-7f31-4118-b753-461a4979d4a9 (9871b2d0-7f31-4118-b753-461a4979d4a9): created successfully Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283594c1-bb3f-4904-8adb-73b438b003b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Flow 'volume_create_manager' (b52c75cc-f1d0-4568-8247-f3507385e4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-94c35f44-4ee2-4d62-a94c-afe37a085f16 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-b5c3fe64-9cdf-473a-b6a9-7841f9cb5c48-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4e7661a7-a1e7-412b-b5a6-2c5dd51305c8 tempest-SnapshotDependencyTests-1992107649 None] Created volume successfully. Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Flow 'volume_create_manager' (98bdbc03-b5e5-4d5d-89c1-c9b42745b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11eb0833-bd58-43bb-94e0-faf6e0e8b309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11eb0833-bd58-43bb-94e0-faf6e0e8b309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074564638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358ca5f3-1468-41ec-8caf-c4ebc9719690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7cc61d1ebd4ef3b56969bfa539e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:01Z,use_quota=True,user_id='40276a0e3b7e4319809df5e2af8493f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6113bf7d-dce0-446a-be2d-1dea23b1d190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6113bf7d-dce0-446a-be2d-1dea23b1d190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9025d9-4c36-4f07-9b5d-59c95af72680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9025d9-4c36-4f07-9b5d-59c95af72680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '358ca5f3-1468-41ec-8caf-c4ebc9719690', 'volume_name': 'volume-358ca5f3-1468-41ec-8caf-c4ebc9719690', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90070d97-95f0-4a47-88aa-c17cbc4ba1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90070d97-95f0-4a47-88aa-c17cbc4ba1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f2d32a-e826-4b30-8461-8427d1a3068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Volume 358ca5f3-1468-41ec-8caf-c4ebc9719690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-358ca5f3-1468-41ec-8caf-c4ebc9719690', 'volume_size': 1} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:01 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-65e93a5c-a330-4bad-b3b0-f215232a3e22 1073741824" returned: 0 in 0.622s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-65e93a5c-a330-4bad-b3b0-f215232a3e22 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:01 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-65e93a5c-a330-4bad-b3b0-f215232a3e22 Sep 04 06:17:01 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:01 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-65e93a5c-a330-4bad-b3b0-f215232a3e22" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074564638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358ca5f3-1468-41ec-8caf-c4ebc9719690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7cc61d1ebd4ef3b56969bfa539e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:01Z,use_quota=True,user_id='40276a0e3b7e4319809df5e2af8493f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Creating volume 358ca5f3-1468-41ec-8caf-c4ebc9719690 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:01 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4dab3dd-74fa-440f-8096-f0f6c5d0f9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e93a5c-a330-4bad-b3b0-f215232a3e22', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a91cc1b-5bb0-4906-9a16-d711866ebed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:01 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 1073741824 Sep 04 06:17:01 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Volume volume-65e93a5c-a330-4bad-b3b0-f215232a3e22 (65e93a5c-a330-4bad-b3b0-f215232a3e22): created successfully Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a91cc1b-5bb0-4906-9a16-d711866ebed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Flow 'volume_create_manager' (cd1b1a15-71ff-40cd-8773-7499f3cbf946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d282f64d-3bc9-4057-b2df-98e02f3fd606 tempest-ProjectReaderTests-1809164788 None] Created volume successfully. Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "cinder-69c5f741-e200-4896-9731-764b76d7b549-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-69c5f741-e200-4896-9731-764b76d7b549-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "cinder-quobyte-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-quobyte-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "cinder-quobyte-69c5f741-e200-4896-9731-764b76d7b549" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-quobyte-69c5f741-e200-4896-9731-764b76d7b549" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Deleting offline snapshot 69c5f741-e200-4896-9731-764b76d7b549 of volume 5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] snapshot_file for this snap is: volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a3ddcc-aa34-4549-9cf8-1874e67bf22f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:02 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 Sep 04 06:17:02 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:02 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 1073741824" returned: 0 in 0.527s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:02 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 Sep 04 06:17:02 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Acquiring lock "cinder-65e93a5c-a330-4bad-b3b0-f215232a3e22-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:02 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549" returned: 0 in 0.447s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Lock "cinder-65e93a5c-a330-4bad-b3b0-f215232a3e22-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[177cbe55-bf8d-4f5e-97cd-54b8777ce41f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Acquiring lock "cinder-quobyte-65e93a5c-a330-4bad-b3b0-f215232a3e22" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Lock "cinder-quobyte-65e93a5c-a330-4bad-b3b0-f215232a3e22" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:02 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d Sep 04 06:17:02 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27a8306-6876-4ebd-8eaf-ee2de7b51ca2]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-65e93a5c-a330-4bad-b3b0-f215232a3e22 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:02 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690" returned: 0 in 0.329s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f2d32a-e826-4b30-8461-8427d1a3068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-358ca5f3-1468-41ec-8caf-c4ebc9719690', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6931473c-d66e-404e-8376-d4d1623571f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Volume volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 (358ca5f3-1468-41ec-8caf-c4ebc9719690): created successfully Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6931473c-d66e-404e-8376-d4d1623571f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Flow 'volume_create_manager' (98bdbc03-b5e5-4d5d-89c1-c9b42745b933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b20923e1-256e-43ab-9fc6-24357881e662 tempest-ProjectReaderTests-1022205293 None] Created volume successfully. Sep 04 06:17:02 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-65e93a5c-a330-4bad-b3b0-f215232a3e22 Sep 04 06:17:02 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:03 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:03 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-65e93a5c-a330-4bad-b3b0-f215232a3e22" returned: 0 in 0.433s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-65e93a5c-a330-4bad-b3b0-f215232a3e22 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d" returned: 0 in 0.574s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:03 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-65e93a5c-a330-4bad-b3b0-f215232a3e22 Sep 04 06:17:03 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:03 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 Sep 04 06:17:03 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:03 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-65e93a5c-a330-4bad-b3b0-f215232a3e22" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Lock "cinder-quobyte-65e93a5c-a330-4bad-b3b0-f215232a3e22" released by "delete_volume" :: held 0.765s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Created reservations ['12fa24b1-9bfc-4be9-ac5c-638f933abde1', 'd176ba4a-32d1-41d5-9363-268efe9fd538', 'dc723832-4d07-4491-ac95-23f29c2b0d57', '2473a2bb-d431-488b-87ee-003e7d7c33b5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:03 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:03 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549 Sep 04 06:17:03 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:03 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:03 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] Creating offline snapshot c6d10e23-8210-4f99-837a-776568446b7e of volume 358ca5f3-1468-41ec-8caf-c4ebc9719690 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ebed39-e2c2-47e5-a5a8-2de08c44defe]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:03 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d.69c5f741-e200-4896-9731-764b76d7b549" returned: 0 in 0.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:03 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 Sep 04 06:17:03 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:04 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-quobyte-69c5f741-e200-4896-9731-764b76d7b549" released by "_delete_snapshot" :: held 1.904s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-quobyte-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d" released by "delete_snapshot" :: held 1.944s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Deleted volume successfully. Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-37c1e02b-4741-4553-a924-f74c2671a8bd tempest-ProjectReaderTests-1809164788 None] Lock "cinder-65e93a5c-a330-4bad-b3b0-f215232a3e22-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Created reservations ['fddc977c-2df0-4a83-9a0f-990dee473921', '6aa0e73e-cd74-4cfa-a813-e02576473010', 'aa9e4fde-8053-4a9a-a638-cb10dd23428b', '87196c25-cf5d-48d4-8987-f11177ba6556'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Delete snapshot completed successfully. Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-195a41a7-820c-4d78-a6ce-f74acecfb638 tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-69c5f741-e200-4896-9731-764b76d7b549-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:04 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (f772f662-cbc2-4762-a19d-2056b7a4e114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba78cc9-c3e4-483e-bd51-9afdd4c68847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690" returned: 0 in 0.536s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba78cc9-c3e4-483e-bd51-9afdd4c68847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1411073312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e01daf2-70ed-437c-98e2-fc57e7c92f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:04Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:04 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e 1G Sep 04 06:17:04 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80975f2-b5d2-4497-be53-210b417cef50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80975f2-b5d2-4497-be53-210b417cef50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e6ce4e-3743-4fdf-ac32-a6468ee55237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e6ce4e-3743-4fdf-ac32-a6468ee55237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e01daf2-70ed-437c-98e2-fc57e7c92f91', 'volume_name': 'volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5859388e-a307-4521-8bee-0d24c8d7e8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5859388e-a307-4521-8bee-0d24c8d7e8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c969b65-4f1f-4c99-8705-f545018e0e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Volume 7e01daf2-70ed-437c-98e2-fc57e7c92f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91', 'volume_size': 1} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Flow 'volume_create_manager' (ef99ef39-1d1d-48ff-95fa-6d97d39f8480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56537d01-e21f-4d2d-b668-fc6a4af117af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56537d01-e21f-4d2d-b668-fc6a4af117af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1841874711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ce33d6-70b7-49ea-881e-6ccd83bfe048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658ae962fc174a9f9188506e28b71f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:04Z,use_quota=True,user_id='2fcc8453faf64632ae8857594e88426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16649b26-ebe6-40f1-a3a6-1107093dbdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16649b26-ebe6-40f1-a3a6-1107093dbdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f932165d-65fc-426e-99d3-fb9fc3e8715e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f932165d-65fc-426e-99d3-fb9fc3e8715e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ce33d6-70b7-49ea-881e-6ccd83bfe048', 'volume_name': 'volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be422d9-dcc4-49ac-945e-ecdd6d683366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be422d9-dcc4-49ac-945e-ecdd6d683366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6e0a70-4717-475f-b572-958310f23a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Volume e8ce33d6-70b7-49ea-881e-6ccd83bfe048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048', 'volume_size': 1} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:04 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e 1G" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:04 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e Sep 04 06:17:04 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:05 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:05 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e is being set with open permissions: ugo+rw Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:05 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e Sep 04 06:17:05 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:05 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:05 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.info Sep 04 06:17:05 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "cinder-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "cinder-quobyte-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-quobyte-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04ac919-65c6-4132-b684-19df6d52ded9]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:05 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d Sep 04 06:17:05 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:05 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.info" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:05 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.info is being set with open permissions: ugo+rw Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:05 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.info Sep 04 06:17:05 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:05 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:05 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.info" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:05 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d Sep 04 06:17:05 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.416s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1411073312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e01daf2-70ed-437c-98e2-fc57e7c92f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:04Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Creating volume 7e01daf2-70ed-437c-98e2-fc57e7c92f91 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:05 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:05 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 1073741824 Sep 04 06:17:05 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-074ee508-4190-4e8e-8a73-2b38a5cc617b tempest-ProjectReaderTests-1022205293 None] Create snapshot completed successfully Sep 04 06:17:06 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-quobyte-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d" released by "delete_volume" :: held 0.677s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Created reservations ['8ac3c39d-3224-4c95-93ab-d61f815deb20', '22083769-bd40-440b-bcfa-7309bc6534d9', '64f99b8c-8948-4587-a789-b6730fb3388c', '3e7a8b39-7b06-43b8-88e0-f8ecc30b370c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:06 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:06 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:06 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 1073741824" returned: 0 in 0.462s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:06 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 Sep 04 06:17:06 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:06 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Deleted volume successfully. Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "cinder-9871b2d0-7f31-4118-b753-461a4979d4a9-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-81f140cc-a59d-4471-8dc6-79f1df808b6e tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-5321c3a0-fa0e-4107-b9c5-685ffe3bbb1d-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-9871b2d0-7f31-4118-b753-461a4979d4a9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "cinder-quobyte-9871b2d0-7f31-4118-b753-461a4979d4a9" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-quobyte-9871b2d0-7f31-4118-b753-461a4979d4a9" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebeda5e-2b33-4592-9c39-806f0e65bb18]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:06 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91" returned: 0 in 0.301s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.033s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1841874711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ce33d6-70b7-49ea-881e-6ccd83bfe048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658ae962fc174a9f9188506e28b71f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:04Z,use_quota=True,user_id='2fcc8453faf64632ae8857594e88426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Creating volume e8ce33d6-70b7-49ea-881e-6ccd83bfe048 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c969b65-4f1f-4c99-8705-f545018e0e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492e3eab-ccf8-47b1-a0c4-c13134ae9ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:06 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048 1073741824 Sep 04 06:17:06 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Volume volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 (7e01daf2-70ed-437c-98e2-fc57e7c92f91): created successfully Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492e3eab-ccf8-47b1-a0c4-c13134ae9ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (f772f662-cbc2-4762-a19d-2056b7a4e114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e7466568-5ae7-4dbe-8385-2569ff8a15e7 tempest-ProjectMemberTests-157241486 None] Created volume successfully. Sep 04 06:17:06 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9 Sep 04 06:17:06 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-c6d10e23-8210-4f99-837a-776568446b7e-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-c6d10e23-8210-4f99-837a-776568446b7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-358ca5f3-1468-41ec-8caf-c4ebc9719690" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-358ca5f3-1468-41ec-8caf-c4ebc9719690" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-c6d10e23-8210-4f99-837a-776568446b7e" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-c6d10e23-8210-4f99-837a-776568446b7e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Deleting offline snapshot c6d10e23-8210-4f99-837a-776568446b7e of volume 358ca5f3-1468-41ec-8caf-c4ebc9719690 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] snapshot_file for this snap is: volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1ac06e-e947-46f5-9fbe-421debf1bbbc]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:07 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9" returned: 0 in 0.433s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:07 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9 Sep 04 06:17:07 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:07 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e Sep 04 06:17:07 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:07 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048 1073741824" returned: 0 in 0.533s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:07 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048 Sep 04 06:17:07 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:07 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9871b2d0-7f31-4118-b753-461a4979d4a9" returned: 0 in 0.342s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-quobyte-9871b2d0-7f31-4118-b753-461a4979d4a9" released by "delete_volume" :: held 0.819s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:07 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e" returned: 0 in 0.446s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-358ca5f3-1468-41ec-8caf-c4ebc9719690(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:17:07 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fc384a-5eb2-49a2-adaf-bdc5e5597de1]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6e0a70-4717-475f-b572-958310f23a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7313e702-61df-4516-aa17-f903b7ea9203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Created reservations ['ba50acf2-e92b-47b3-a07e-3273dbd81026', '0e98fddb-3017-4713-afec-6dbd637655d4', '9d699810-06d1-4913-aa6b-47019df7a37d', 'e22909ee-ab6f-4153-a72e-deb9565c0e6a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Volume volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048 (e8ce33d6-70b7-49ea-881e-6ccd83bfe048): created successfully Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7313e702-61df-4516-aa17-f903b7ea9203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Flow 'volume_create_manager' (ef99ef39-1d1d-48ff-95fa-6d97d39f8480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ed1abd0a-44d6-4619-8880-ea9946c3ab93 tempest-ProjectReaderTests-1809164788 None] Created volume successfully. Sep 04 06:17:07 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 Sep 04 06:17:07 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:07 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:07 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "cinder-e8ce33d6-70b7-49ea-881e-6ccd83bfe048-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Lock "cinder-e8ce33d6-70b7-49ea-881e-6ccd83bfe048-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] Creating offline snapshot 9ae9756c-238c-4b8f-b0c2-89775d56490d of volume 7e01daf2-70ed-437c-98e2-fc57e7c92f91 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[607fe8f0-8386-4116-a5b6-d70e4dfc4248]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "cinder-quobyte-e8ce33d6-70b7-49ea-881e-6ccd83bfe048" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Lock "cinder-quobyte-e8ce33d6-70b7-49ea-881e-6ccd83bfe048" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[226b8262-0e25-4dd9-8630-f989d18ef63b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:08 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690" returned: 0 in 0.612s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:08 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 Sep 04 06:17:08 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e Sep 04 06:17:08 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:08 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:08 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Deleted volume successfully. Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7b84ea69-ec84-4d86-a9ab-9308f71bbdaf tempest-SnapshotDependencyTests-1992107649 None] Lock "cinder-9871b2d0-7f31-4118-b753-461a4979d4a9-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:08 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048 Sep 04 06:17:08 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:08 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e" returned: 0 in 0.375s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:08 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91" returned: 0 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:08 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e Sep 04 06:17:08 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:08 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d 1G Sep 04 06:17:08 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:08 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048" returned: 0 in 0.514s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:08 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048 Sep 04 06:17:08 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:08 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690.c6d10e23-8210-4f99-837a-776568446b7e" returned: 0 in 0.318s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-c6d10e23-8210-4f99-837a-776568446b7e" released by "_delete_snapshot" :: held 1.891s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-358ca5f3-1468-41ec-8caf-c4ebc9719690" released by "delete_snapshot" :: held 1.920s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Created reservations ['256e9415-f83a-4a4f-aa6e-dcabc15a64a8', 'eae2aca4-36c1-4965-a55f-e375d4bf9baa', '5055ae2e-4f64-4764-82ba-944d4e066f93', 'aeaaf9db-e360-4483-883a-fe2d14d91df9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:08 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-e8ce33d6-70b7-49ea-881e-6ccd83bfe048" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Lock "cinder-quobyte-e8ce33d6-70b7-49ea-881e-6ccd83bfe048" released by "delete_volume" :: held 0.957s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Delete snapshot completed successfully. Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-421655db-cbc9-459c-9427-19c26a887260 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-c6d10e23-8210-4f99-837a-776568446b7e-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-358ca5f3-1468-41ec-8caf-c4ebc9719690-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Created reservations ['382161e8-7ad0-4ef7-9172-1f837186222a', 'bde9bc31-7edc-4fc7-b4ad-0b354d4489b0', '3b51437b-d9e7-4fe8-b346-19c58ec0ca70', '9f615916-0182-47cc-abc3-52585c078477'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:09 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d 1G" returned: 0 in 0.660s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:09 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d Sep 04 06:17:09 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Lock "cinder-358ca5f3-1468-41ec-8caf-c4ebc9719690-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-358ca5f3-1468-41ec-8caf-c4ebc9719690" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-358ca5f3-1468-41ec-8caf-c4ebc9719690" acquired by "delete_volume" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:09 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:09 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2315839-147e-479e-8910-38418847657f]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:09 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 Sep 04 06:17:09 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:09 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d" returned: 0 in 0.402s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:09 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d is being set with open permissions: ugo+rw Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:09 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.301s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Deleted volume successfully. Sep 04 06:17:09 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d Sep 04 06:17:09 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69bcc99e-3053-41c2-ae7b-45a9e916b328 tempest-ProjectReaderTests-1809164788 None] Lock "cinder-e8ce33d6-70b7-49ea-881e-6ccd83bfe048-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:09 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690" returned: 0 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:09 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:09 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690 Sep 04 06:17:09 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:09 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.info Sep 04 06:17:09 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:10 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-358ca5f3-1468-41ec-8caf-c4ebc9719690" returned: 0 in 0.318s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-358ca5f3-1468-41ec-8caf-c4ebc9719690" released by "delete_volume" :: held 0.897s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:10 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.info" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:10 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.info is being set with open permissions: ugo+rw Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Created reservations ['47e812d4-2cae-48bd-bf5b-8879c28b1fa6', '70567ed9-45d0-4eda-af89-3e1d9bbc7aac', '8190b0d4-c2d1-4084-aaad-264bb19b2893', '37a49b39-b69d-4844-a2ca-e02cd022f779'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:10 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.info Sep 04 06:17:10 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:10 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:10 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:10 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.info" returned: 0 in 0.332s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6fd34f26-7560-4973-9c01-d4f1a194eabb tempest-ProjectMemberTests-157241486 None] Create snapshot completed successfully Sep 04 06:17:10 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Flow 'volume_create_manager' (0e2967ae-46ec-4047-a6b1-7bbd5e4015cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad7e215-b384-4dc2-8656-b6f9212310e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Deleted volume successfully. Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad7e215-b384-4dc2-8656-b6f9212310e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664494714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f494bbd-1a75-488c-abd5-5d6e10861083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658ae962fc174a9f9188506e28b71f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:11Z,use_quota=True,user_id='2fcc8453faf64632ae8857594e88426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41c52f6-1f86-433c-bc45-5709e7860d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41c52f6-1f86-433c-bc45-5709e7860d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e291f181-c8db-495c-85f0-2f938fdc9714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e291f181-c8db-495c-85f0-2f938fdc9714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f494bbd-1a75-488c-abd5-5d6e10861083', 'volume_name': 'volume-3f494bbd-1a75-488c-abd5-5d6e10861083', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b97b2f6-0b63-4841-bd78-63e0af9a4375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b97b2f6-0b63-4841-bd78-63e0af9a4375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0245f2b6-7fa9-4c5d-8edb-3310107a1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Volume 3f494bbd-1a75-488c-abd5-5d6e10861083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f494bbd-1a75-488c-abd5-5d6e10861083', 'volume_size': 1} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664494714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f494bbd-1a75-488c-abd5-5d6e10861083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658ae962fc174a9f9188506e28b71f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:11Z,use_quota=True,user_id='2fcc8453faf64632ae8857594e88426b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Creating volume 3f494bbd-1a75-488c-abd5-5d6e10861083 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:10 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3f494bbd-1a75-488c-abd5-5d6e10861083 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-156d9174-b385-4321-bb78-137c70b1263d tempest-ProjectReaderTests-1022205293 None] Lock "cinder-358ca5f3-1468-41ec-8caf-c4ebc9719690-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:10 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3f494bbd-1a75-488c-abd5-5d6e10861083 1073741824 Sep 04 06:17:10 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-9ae9756c-238c-4b8f-b0c2-89775d56490d-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Lock "cinder-9ae9756c-238c-4b8f-b0c2-89775d56490d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-7e01daf2-70ed-437c-98e2-fc57e7c92f91" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-7e01daf2-70ed-437c-98e2-fc57e7c92f91" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-9ae9756c-238c-4b8f-b0c2-89775d56490d" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-9ae9756c-238c-4b8f-b0c2-89775d56490d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Deleting offline snapshot 9ae9756c-238c-4b8f-b0c2-89775d56490d of volume 7e01daf2-70ed-437c-98e2-fc57e7c92f91 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] snapshot_file for this snap is: volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9c623e-f62e-448a-8357-338f82d7579d]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:11 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d Sep 04 06:17:11 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:11 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3f494bbd-1a75-488c-abd5-5d6e10861083 1073741824" returned: 0 in 0.505s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3f494bbd-1a75-488c-abd5-5d6e10861083 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:11 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3f494bbd-1a75-488c-abd5-5d6e10861083 Sep 04 06:17:11 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:11 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d" returned: 0 in 0.412s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[128c2a4f-c1a5-4420-8c7b-b15963dc6aa9]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:11 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3f494bbd-1a75-488c-abd5-5d6e10861083" returned: 0 in 0.294s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0245f2b6-7fa9-4c5d-8edb-3310107a1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f494bbd-1a75-488c-abd5-5d6e10861083', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7063022-5778-4695-9344-403d25f9f7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Volume volume-3f494bbd-1a75-488c-abd5-5d6e10861083 (3f494bbd-1a75-488c-abd5-5d6e10861083): created successfully Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7063022-5778-4695-9344-403d25f9f7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Flow 'volume_create_manager' (0e2967ae-46ec-4047-a6b1-7bbd5e4015cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d4e828cd-72cf-4f00-8a0f-80a2a376416c tempest-ProjectReaderTests-1809164788 None] Created volume successfully. Sep 04 06:17:11 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 Sep 04 06:17:11 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:11 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Flow 'volume_create_manager' (c399e66a-51b9-434b-94a4-05289b7d7fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617e8c40-caf1-42b6-ad94-6498ee761add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617e8c40-caf1-42b6-ad94-6498ee761add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980679610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b14f57-a517-4dda-a184-c2681c42906c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7cc61d1ebd4ef3b56969bfa539e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:12Z,use_quota=True,user_id='40276a0e3b7e4319809df5e2af8493f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f95ad00-d897-43f4-a953-c19880262896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f95ad00-d897-43f4-a953-c19880262896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327791ad-93bb-4ba4-b6e7-5d40e1f95a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327791ad-93bb-4ba4-b6e7-5d40e1f95a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8b14f57-a517-4dda-a184-c2681c42906c', 'volume_name': 'volume-f8b14f57-a517-4dda-a184-c2681c42906c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e40394c-97a9-4604-9d39-022ac312b049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e40394c-97a9-4604-9d39-022ac312b049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86831545-5932-4b75-82bb-bff508a5d106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Volume f8b14f57-a517-4dda-a184-c2681c42906c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8b14f57-a517-4dda-a184-c2681c42906c', 'volume_size': 1} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980679610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b14f57-a517-4dda-a184-c2681c42906c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7cc61d1ebd4ef3b56969bfa539e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:12Z,use_quota=True,user_id='40276a0e3b7e4319809df5e2af8493f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Creating volume f8b14f57-a517-4dda-a184-c2681c42906c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:12 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:12 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c 1073741824 Sep 04 06:17:12 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:12 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91" returned: 0 in 0.521s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:12 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d Sep 04 06:17:12 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:12 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d" returned: 0 in 0.406s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:12 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c 1073741824" returned: 0 in 0.573s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:12 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d Sep 04 06:17:12 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:12 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c Sep 04 06:17:12 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "cinder-3f494bbd-1a75-488c-abd5-5d6e10861083-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Lock "cinder-3f494bbd-1a75-488c-abd5-5d6e10861083-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:13 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91.9ae9756c-238c-4b8f-b0c2-89775d56490d" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "cinder-quobyte-3f494bbd-1a75-488c-abd5-5d6e10861083" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-9ae9756c-238c-4b8f-b0c2-89775d56490d" released by "_delete_snapshot" :: held 1.898s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Lock "cinder-quobyte-3f494bbd-1a75-488c-abd5-5d6e10861083" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:13 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-7e01daf2-70ed-437c-98e2-fc57e7c92f91" released by "delete_snapshot" :: held 1.952s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c" returned: 0 in 0.446s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faf947d-ad1a-4186-b15b-7bb22d4cea74]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3f494bbd-1a75-488c-abd5-5d6e10861083 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86831545-5932-4b75-82bb-bff508a5d106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8b14f57-a517-4dda-a184-c2681c42906c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4381bae0-a476-4c75-a206-f9c0c8171551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Volume volume-f8b14f57-a517-4dda-a184-c2681c42906c (f8b14f57-a517-4dda-a184-c2681c42906c): created successfully Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4381bae0-a476-4c75-a206-f9c0c8171551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Flow 'volume_create_manager' (c399e66a-51b9-434b-94a4-05289b7d7fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3658ff32-d16e-44ea-966d-4880c4424cd8 tempest-ProjectReaderTests-1022205293 None] Created volume successfully. Sep 04 06:17:13 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3f494bbd-1a75-488c-abd5-5d6e10861083 Sep 04 06:17:13 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Created reservations ['0dd64609-e466-4615-812c-51df023fc3f2', 'e5cdb0c6-be1b-484b-b521-53464b0d979e', 'ff4567fb-f128-4b00-b913-50ae3dc75e36', '5dc22aff-2ea9-41a3-b38d-ec7566bd8389'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Delete snapshot completed successfully. Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e89dd894-a674-4df9-ae5b-b4a43af31dce tempest-ProjectMemberTests-157241486 None] Lock "cinder-9ae9756c-238c-4b8f-b0c2-89775d56490d-delete_snapshot" released by "delete_snapshot" :: held 2.235s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:13 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3f494bbd-1a75-488c-abd5-5d6e10861083" returned: 0 in 0.413s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3f494bbd-1a75-488c-abd5-5d6e10861083 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:13 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3f494bbd-1a75-488c-abd5-5d6e10861083 Sep 04 06:17:13 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:13 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-3f494bbd-1a75-488c-abd5-5d6e10861083" returned: 0 in 0.261s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Lock "cinder-quobyte-3f494bbd-1a75-488c-abd5-5d6e10861083" released by "delete_volume" :: held 0.740s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Created reservations ['6bffa708-29a9-47b6-89ad-5c17657db013', 'f4afb858-99ea-47ff-b74f-c9118bd7c2de', '97f973ae-f351-4ca0-b87e-0906e6fbe67f', '6c8e60f1-69bd-4001-ad9c-6ba91c02d722'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:14 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:14 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:14 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Deleted volume successfully. Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d046f0c-f881-47ae-ad5a-252f3757db20 tempest-ProjectReaderTests-1809164788 None] Lock "cinder-3f494bbd-1a75-488c-abd5-5d6e10861083-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] Creating offline snapshot 93adfeaa-c14d-481d-9181-8ca4467925e7 of volume f8b14f57-a517-4dda-a184-c2681c42906c {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c69e5ea-4870-4f61-b6be-1ad7f64eaf81]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-7e01daf2-70ed-437c-98e2-fc57e7c92f91-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Lock "cinder-7e01daf2-70ed-437c-98e2-fc57e7c92f91-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-7e01daf2-70ed-437c-98e2-fc57e7c92f91" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-7e01daf2-70ed-437c-98e2-fc57e7c92f91" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:14 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c Sep 04 06:17:14 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9ac243-f009-4aac-af08-56cfe6063ddc]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:14 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 Sep 04 06:17:14 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:14 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c" returned: 0 in 0.486s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:14 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 1G Sep 04 06:17:14 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:15 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91" returned: 0 in 0.479s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:15 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91 Sep 04 06:17:15 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:15 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-7e01daf2-70ed-437c-98e2-fc57e7c92f91" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-7e01daf2-70ed-437c-98e2-fc57e7c92f91" released by "delete_volume" :: held 0.948s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:15 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 1G" returned: 0 in 0.638s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b14f57-a517-4dda-a184-c2681c42906c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:15 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b14f57-a517-4dda-a184-c2681c42906c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 Sep 04 06:17:15 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Created reservations ['71c742cf-4bf0-41d3-aa4a-9eb8d57a352c', '70e0f402-7fcf-4fdb-9863-48618c62146e', '6d5c87d4-3d52-470e-bc3e-deefe68bc71d', 'fe462924-7348-48fc-ae7f-46c25c13907e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:15 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:15 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:16 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b14f57-a517-4dda-a184-c2681c42906c -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:16 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 is being set with open permissions: ugo+rw Sep 04 06:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:16 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 Sep 04 06:17:16 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:16 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.371s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:16 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Deleted volume successfully. Sep 04 06:17:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29527ad4-62a4-4afe-8ed2-b73b2eb454f7 tempest-ProjectMemberTests-157241486 None] Lock "cinder-7e01daf2-70ed-437c-98e2-fc57e7c92f91-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:16 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:16 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.info Sep 04 06:17:16 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:16 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.info" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:16 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.info is being set with open permissions: ugo+rw Sep 04 06:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:16 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.info Sep 04 06:17:16 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:17 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.info" returned: 0 in 0.270s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-38d179dc-9a08-4b27-b682-aa3b76f003e7 tempest-ProjectReaderTests-1022205293 None] Create snapshot completed successfully Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (34a5a566-f882-45c8-8be5-1448b219b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06581892-b4ea-4510-8d5a-449921c18c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06581892-b4ea-4510-8d5a-449921c18c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1114709617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc82019-2d70-4237-bcf0-f6d0b3687376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:17Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5672212-1a94-4300-b654-2814495eee95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5672212-1a94-4300-b654-2814495eee95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72cbeb68-60b9-4c98-a362-415781aa533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72cbeb68-60b9-4c98-a362-415781aa533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc82019-2d70-4237-bcf0-f6d0b3687376', 'volume_name': 'volume-8cc82019-2d70-4237-bcf0-f6d0b3687376', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77652cd-1d9a-432c-920d-a77ae651fc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77652cd-1d9a-432c-920d-a77ae651fc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff6d726-525a-4f80-a089-92e695111bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Volume 8cc82019-2d70-4237-bcf0-f6d0b3687376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc82019-2d70-4237-bcf0-f6d0b3687376', 'volume_size': 1} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1114709617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc82019-2d70-4237-bcf0-f6d0b3687376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:17Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Creating volume 8cc82019-2d70-4237-bcf0-f6d0b3687376 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:17 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:17 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 1073741824 Sep 04 06:17:17 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-93adfeaa-c14d-481d-9181-8ca4467925e7-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-93adfeaa-c14d-481d-9181-8ca4467925e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-f8b14f57-a517-4dda-a184-c2681c42906c" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-f8b14f57-a517-4dda-a184-c2681c42906c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-93adfeaa-c14d-481d-9181-8ca4467925e7" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-93adfeaa-c14d-481d-9181-8ca4467925e7" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Deleting offline snapshot 93adfeaa-c14d-481d-9181-8ca4467925e7 of volume f8b14f57-a517-4dda-a184-c2681c42906c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] snapshot_file for this snap is: volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7e8ade-6bd5-487a-a2ab-95bc2a2e0c20]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:17 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 Sep 04 06:17:17 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:17 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 1073741824" returned: 0 in 0.575s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:18 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 Sep 04 06:17:18 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:18 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7" returned: 0 in 0.424s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8b14f57-a517-4dda-a184-c2681c42906c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca085935-7e86-47a8-bb7e-60831077a913]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:18 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376" returned: 0 in 0.300s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff6d726-525a-4f80-a089-92e695111bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc82019-2d70-4237-bcf0-f6d0b3687376', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f789ad0-b39e-4c85-9c7e-65e339b1bcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Volume volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 (8cc82019-2d70-4237-bcf0-f6d0b3687376): created successfully Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f789ad0-b39e-4c85-9c7e-65e339b1bcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (34a5a566-f882-45c8-8be5-1448b219b457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ae1950a4-bd34-4a7d-9a53-9df0fa202add tempest-ProjectMemberTests-157241486 None] Created volume successfully. Sep 04 06:17:18 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c Sep 04 06:17:18 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:18 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c" returned: 0 in 0.432s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:18 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 Sep 04 06:17:18 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:19 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:19 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7 Sep 04 06:17:19 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:19 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c.93adfeaa-c14d-481d-9181-8ca4467925e7" returned: 0 in 0.286s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-93adfeaa-c14d-481d-9181-8ca4467925e7" released by "_delete_snapshot" :: held 1.682s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-f8b14f57-a517-4dda-a184-c2681c42906c" released by "delete_snapshot" :: held 1.720s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Created reservations ['92c00013-5fc5-4e42-b62a-1d1e18c3cf2c', '137b3cc8-bbf8-4729-8ab4-fd15a90b4615', 'a36c0c47-a88f-472a-a9f5-468afbce5b95', '6d5b1501-3a3c-4f46-995a-227dc24da649'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] Creating offline snapshot 3b783940-4bd7-43c6-b4fd-132ad8ff76c7 of volume 8cc82019-2d70-4237-bcf0-f6d0b3687376 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa93eaf-1576-430d-89a5-bb0ae7bd68c3]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Delete snapshot completed successfully. Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d9e6c14d-34a7-4622-a6b1-f46273d64201 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-93adfeaa-c14d-481d-9181-8ca4467925e7-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:19 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 Sep 04 06:17:19 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-f8b14f57-a517-4dda-a184-c2681c42906c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-f8b14f57-a517-4dda-a184-c2681c42906c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-f8b14f57-a517-4dda-a184-c2681c42906c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-f8b14f57-a517-4dda-a184-c2681c42906c" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec5097b-fc48-453a-b107-59ca8f78bf47]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:20 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376" returned: 0 in 0.439s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:20 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 1G Sep 04 06:17:20 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:20 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c Sep 04 06:17:20 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:20 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c" returned: 0 in 0.441s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:20 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c Sep 04 06:17:20 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:20 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 1G" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:20 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 Sep 04 06:17:20 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:20 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-f8b14f57-a517-4dda-a184-c2681c42906c" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-f8b14f57-a517-4dda-a184-c2681c42906c" released by "delete_volume" :: held 0.805s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Created reservations ['63e117a2-12eb-437f-85e2-58c5f674a365', '436490cc-d18a-4ad0-995a-4b7c7c51f87e', '14fb7760-d881-47e8-b0cc-1bfec00c0a53', 'e1be85a8-a074-4b15-ad6c-77b77481aa0a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:20 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:20 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 is being set with open permissions: ugo+rw Sep 04 06:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:20 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:20 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:20 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 Sep 04 06:17:20 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:21 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.302s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:21 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7" returned: 0 in 0.289s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Deleted volume successfully. Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2a69355-9bbc-4ff9-a9d4-dd6f0d311fa8 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-f8b14f57-a517-4dda-a184-c2681c42906c-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:21 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.info Sep 04 06:17:21 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:21 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.info" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:21 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.info is being set with open permissions: ugo+rw Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:21 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.info Sep 04 06:17:21 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Flow 'volume_create_manager' (a9ae7468-984d-4a52-bbc6-7c9b91829a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038542e6-f54c-4e2a-b060-dbb6144340ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038542e6-f54c-4e2a-b060-dbb6144340ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918356136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d50b8dd-d317-4d7d-8f0e-45914e4a0043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7cc61d1ebd4ef3b56969bfa539e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:21Z,use_quota=True,user_id='40276a0e3b7e4319809df5e2af8493f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5345d6ea-84dc-4685-8ee7-7600152099f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5345d6ea-84dc-4685-8ee7-7600152099f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b989dfaf-60b7-43f9-9880-2bce0bc4bbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b989dfaf-60b7-43f9-9880-2bce0bc4bbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d50b8dd-d317-4d7d-8f0e-45914e4a0043', 'volume_name': 'volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e712f7-4cd6-4463-91cf-99e4b82ba392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e712f7-4cd6-4463-91cf-99e4b82ba392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ca8e25-8c99-49ed-bf37-71fcdfe8dd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Volume 8d50b8dd-d317-4d7d-8f0e-45914e4a0043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043', 'volume_size': 1} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:21 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.info" returned: 0 in 0.261s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918356136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d50b8dd-d317-4d7d-8f0e-45914e4a0043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7cc61d1ebd4ef3b56969bfa539e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:21Z,use_quota=True,user_id='40276a0e3b7e4319809df5e2af8493f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Creating volume 8d50b8dd-d317-4d7d-8f0e-45914e4a0043 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:21 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:21 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 1073741824 Sep 04 06:17:21 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-10904a09-99e1-4e94-8cd5-9ede62506675 tempest-ProjectMemberTests-157241486 None] Create snapshot completed successfully Sep 04 06:17:22 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 1073741824" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:22 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 Sep 04 06:17:22 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:22 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043" returned: 0 in 0.243s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ca8e25-8c99-49ed-bf37-71fcdfe8dd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c43b70-5ab4-4692-a43e-f5b3ba9c2e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Volume volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 (8d50b8dd-d317-4d7d-8f0e-45914e4a0043): created successfully Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c43b70-5ab4-4692-a43e-f5b3ba9c2e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Flow 'volume_create_manager' (a9ae7468-984d-4a52-bbc6-7c9b91829a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0fc0be67-d2cd-40ac-8569-7953ada843af tempest-ProjectReaderTests-1022205293 None] Created volume successfully. Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-3b783940-4bd7-43c6-b4fd-132ad8ff76c7-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Lock "cinder-3b783940-4bd7-43c6-b4fd-132ad8ff76c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-8cc82019-2d70-4237-bcf0-f6d0b3687376" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-8cc82019-2d70-4237-bcf0-f6d0b3687376" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-3b783940-4bd7-43c6-b4fd-132ad8ff76c7" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-3b783940-4bd7-43c6-b4fd-132ad8ff76c7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Deleting offline snapshot 3b783940-4bd7-43c6-b4fd-132ad8ff76c7 of volume 8cc82019-2d70-4237-bcf0-f6d0b3687376 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] snapshot_file for this snap is: volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f17342-58fd-4ef0-87a6-50c063443e60]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:22 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 Sep 04 06:17:22 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:23 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cc82019-2d70-4237-bcf0-f6d0b3687376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[67726398-5737-4001-8f58-ff3a61683781]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:23 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 Sep 04 06:17:23 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:23 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:23 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 Sep 04 06:17:23 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] Creating offline snapshot ac956365-c7c4-41c9-b664-0a5fa8d64ef6 of volume 8d50b8dd-d317-4d7d-8f0e-45914e4a0043 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2217e7f-c998-4051-8bac-55152057ab65]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:23 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:23 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7 Sep 04 06:17:23 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:23 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 Sep 04 06:17:23 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:24 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376.3b783940-4bd7-43c6-b4fd-132ad8ff76c7" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-3b783940-4bd7-43c6-b4fd-132ad8ff76c7" released by "_delete_snapshot" :: held 1.456s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-8cc82019-2d70-4237-bcf0-f6d0b3687376" released by "delete_snapshot" :: held 1.479s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:24 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043" returned: 0 in 0.390s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:24 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 1G Sep 04 06:17:24 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Created reservations ['bef72073-72dd-43cd-8ba2-45e53486738a', '17a5d6f5-3995-4ac6-82ba-d8ffe0ed95df', 'b3a3d580-d1a3-4927-b4e7-3bb09fbde8ef', 'f2115e58-628a-4bec-ab67-6b81fc5aba18'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Delete snapshot completed successfully. Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a498b257-bfb1-4d72-9d24-7a2bf552adbe tempest-ProjectMemberTests-157241486 None] Lock "cinder-3b783940-4bd7-43c6-b4fd-132ad8ff76c7-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:24 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 1G" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:24 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 Sep 04 06:17:24 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:24 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:24 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 is being set with open permissions: ugo+rw Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-8cc82019-2d70-4237-bcf0-f6d0b3687376-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:24 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 Sep 04 06:17:24 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Lock "cinder-8cc82019-2d70-4237-bcf0-f6d0b3687376-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-8cc82019-2d70-4237-bcf0-f6d0b3687376" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-8cc82019-2d70-4237-bcf0-f6d0b3687376" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[37df783d-e574-43ef-8b44-286d12a64893]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:25 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 Sep 04 06:17:25 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:25 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:25 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.info Sep 04 06:17:25 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:25 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:25 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:25 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:25 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.info" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:25 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376 Sep 04 06:17:25 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.info is being set with open permissions: ugo+rw Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:25 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:25 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.info Sep 04 06:17:25 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:25 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 06:17:25 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8cc82019-2d70-4237-bcf0-f6d0b3687376" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-8cc82019-2d70-4237-bcf0-f6d0b3687376" released by "delete_volume" :: held 0.683s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:25 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.info" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Created reservations ['97720297-5925-4ae2-af25-21a099c5c102', '3f569a52-3a5e-4632-b43e-f3ce512efb8a', '2d031268-a10a-4f98-bb03-8eca35351b71', '9e6f89a8-069a-4139-86b9-9df7450a35c9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-69c952ae-7ebb-4c2f-86e4-0b883da40b91 tempest-ProjectReaderTests-1022205293 None] Create snapshot completed successfully Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:25 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:25 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-ac956365-c7c4-41c9-b664-0a5fa8d64ef6-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-ac956365-c7c4-41c9-b664-0a5fa8d64ef6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-8d50b8dd-d317-4d7d-8f0e-45914e4a0043" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-8d50b8dd-d317-4d7d-8f0e-45914e4a0043" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-ac956365-c7c4-41c9-b664-0a5fa8d64ef6" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-ac956365-c7c4-41c9-b664-0a5fa8d64ef6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Deleting offline snapshot ac956365-c7c4-41c9-b664-0a5fa8d64ef6 of volume 8d50b8dd-d317-4d7d-8f0e-45914e4a0043 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] snapshot_file for this snap is: volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2637c18d-51e9-468f-8509-8b467e28eb58]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:26 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.266s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:26 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 Sep 04 06:17:26 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Deleted volume successfully. Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6230bcd4-e7e2-4f56-b0cd-72141b6c5339 tempest-ProjectMemberTests-157241486 None] Lock "cinder-8cc82019-2d70-4237-bcf0-f6d0b3687376-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:26 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6" returned: 0 in 0.390s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bf6cae-a8e9-44a2-b964-8a88166fe19c]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:26 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 Sep 04 06:17:26 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (1468cdfe-e5a0-4e1d-949f-676c59c56429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f4cfbd-f45b-4b36-9700-2410645ea77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f4cfbd-f45b-4b36-9700-2410645ea77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-729885637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c624ed06-3307-49fa-a2a5-8a93be0c6834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:27Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d1d0af-f890-4cf0-b4e7-a30c9f30a5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d1d0af-f890-4cf0-b4e7-a30c9f30a5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce264d5-ceb8-42c6-9c03-e1f241b679f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce264d5-ceb8-42c6-9c03-e1f241b679f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c624ed06-3307-49fa-a2a5-8a93be0c6834', 'volume_name': 'volume-c624ed06-3307-49fa-a2a5-8a93be0c6834', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39422869-569d-4c50-87b1-44f04bacea56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39422869-569d-4c50-87b1-44f04bacea56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0d4480-262b-4b5b-bf26-78def7f353db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Volume c624ed06-3307-49fa-a2a5-8a93be0c6834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c624ed06-3307-49fa-a2a5-8a93be0c6834', 'volume_size': 1} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-729885637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c624ed06-3307-49fa-a2a5-8a93be0c6834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:27Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Creating volume c624ed06-3307-49fa-a2a5-8a93be0c6834 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:26 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:26 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 1073741824 Sep 04 06:17:26 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:26 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:26 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 Sep 04 06:17:26 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:27 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 1073741824" returned: 0 in 0.390s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:27 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 Sep 04 06:17:27 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:27 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:27 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6 Sep 04 06:17:27 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:27 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834" returned: 0 in 0.256s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0d4480-262b-4b5b-bf26-78def7f353db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c624ed06-3307-49fa-a2a5-8a93be0c6834', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f530f631-53a3-4278-81f7-01e6abf32f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:27 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Volume volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 (c624ed06-3307-49fa-a2a5-8a93be0c6834): created successfully Sep 04 06:17:27 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f530f631-53a3-4278-81f7-01e6abf32f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (1468cdfe-e5a0-4e1d-949f-676c59c56429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043.ac956365-c7c4-41c9-b664-0a5fa8d64ef6" returned: 0 in 0.252s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-ac956365-c7c4-41c9-b664-0a5fa8d64ef6" released by "_delete_snapshot" :: held 1.445s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-332bfa5f-fb25-42e6-b749-050c6ac03641 tempest-ProjectMemberTests-157241486 None] Created volume successfully. Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-8d50b8dd-d317-4d7d-8f0e-45914e4a0043" released by "delete_snapshot" :: held 1.468s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Created reservations ['7b67b90e-bb5a-44f6-8ea4-548b0bf2fea9', '9fdc24dd-68e5-4e64-b83c-74a0fcbc1950', '8b4d459c-8cf0-4918-8c8d-0ef6bbce3f58', 'e3263abe-d167-4e8b-b77c-cd186df4318b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Delete snapshot completed successfully. Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d4f90b41-c6c2-4243-b8ae-0f7faf072d19 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-ac956365-c7c4-41c9-b664-0a5fa8d64ef6-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] Creating offline snapshot faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 of volume c624ed06-3307-49fa-a2a5-8a93be0c6834 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[082b4438-d7d5-40fc-86b5-c505408ff60c]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:27 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 Sep 04 06:17:27 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-8d50b8dd-d317-4d7d-8f0e-45914e4a0043-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:28 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Lock "cinder-8d50b8dd-d317-4d7d-8f0e-45914e4a0043-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:28 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 1G Sep 04 06:17:28 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-8d50b8dd-d317-4d7d-8f0e-45914e4a0043" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-8d50b8dd-d317-4d7d-8f0e-45914e4a0043" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dbca07-caf1-4d64-ab47-1b5c64ca96c0]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:28 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 Sep 04 06:17:28 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:28 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 1G" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:28 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 Sep 04 06:17:28 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:28 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043" returned: 0 in 0.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:28 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043 Sep 04 06:17:28 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:28 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:28 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 is being set with open permissions: ugo+rw Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:28 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 Sep 04 06:17:28 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:28 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-8d50b8dd-d317-4d7d-8f0e-45914e4a0043" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-8d50b8dd-d317-4d7d-8f0e-45914e4a0043" released by "delete_volume" :: held 0.650s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Created reservations ['077961aa-f58a-4aea-bf99-52e7035d411d', '84bd687a-fe2f-428f-85f3-0a08595560d2', '52a74f3a-75f7-4986-bf50-d5b47060c696', 'db4948ec-f20b-4288-935c-870d917b83c5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:29 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:29 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:29 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:29 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.info Sep 04 06:17:29 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:29 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.243s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Deleted volume successfully. Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c42d70c0-e3a3-40da-84d0-e3611b2b149b tempest-ProjectReaderTests-1022205293 None] Lock "cinder-8d50b8dd-d317-4d7d-8f0e-45914e4a0043-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:29 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.info" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:29 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.info is being set with open permissions: ugo+rw Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:29 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.info Sep 04 06:17:29 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:29 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.info" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-366d999a-375c-4bb3-9250-9d4833c10cd9 tempest-ProjectMemberTests-157241486 None] Create snapshot completed successfully Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Flow 'volume_create_manager' (35ae1948-e6d4-4c92-8419-2267ae111277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc4f825-310f-4ce4-a36c-3f1b8c655193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc4f825-310f-4ce4-a36c-3f1b8c655193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1702254878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf77acab-35e1-476d-a4f4-3ec7bd6032ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7cc61d1ebd4ef3b56969bfa539e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:30Z,use_quota=True,user_id='40276a0e3b7e4319809df5e2af8493f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937c3931-9da3-4484-83c2-3ac5a4c6444a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937c3931-9da3-4484-83c2-3ac5a4c6444a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca4d6e0-617a-483d-8494-c77cf9a259ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca4d6e0-617a-483d-8494-c77cf9a259ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf77acab-35e1-476d-a4f4-3ec7bd6032ca', 'volume_name': 'volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65192e97-7c2c-4444-9422-72531485bf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65192e97-7c2c-4444-9422-72531485bf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da785ca-ce10-417b-888d-4d7fe6ddc395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Volume bf77acab-35e1-476d-a4f4-3ec7bd6032ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca', 'volume_size': 1} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1702254878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf77acab-35e1-476d-a4f4-3ec7bd6032ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7cc61d1ebd4ef3b56969bfa539e91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:30Z,use_quota=True,user_id='40276a0e3b7e4319809df5e2af8493f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Creating volume bf77acab-35e1-476d-a4f4-3ec7bd6032ca {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:29 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:29 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca 1073741824 Sep 04 06:17:29 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Lock "cinder-faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-c624ed06-3307-49fa-a2a5-8a93be0c6834" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-c624ed06-3307-49fa-a2a5-8a93be0c6834" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Deleting offline snapshot faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 of volume c624ed06-3307-49fa-a2a5-8a93be0c6834 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] snapshot_file for this snap is: volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff6eaf5-057b-4c51-a04e-1c4029f8b476]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:30 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 Sep 04 06:17:30 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:30 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca 1073741824" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:30 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca Sep 04 06:17:30 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:30 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c624ed06-3307-49fa-a2a5-8a93be0c6834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6993b33c-36dc-4260-b6fc-b949c9df952a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:30 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 Sep 04 06:17:30 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:30 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da785ca-ce10-417b-888d-4d7fe6ddc395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69361edd-98cb-4134-bb62-ac3ea1274f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Volume volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca (bf77acab-35e1-476d-a4f4-3ec7bd6032ca): created successfully Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69361edd-98cb-4134-bb62-ac3ea1274f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Flow 'volume_create_manager' (35ae1948-e6d4-4c92-8419-2267ae111277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8680b627-8bb9-49ca-8d26-a07f0afda36a tempest-ProjectReaderTests-1022205293 None] Created volume successfully. Sep 04 06:17:30 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:30 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 Sep 04 06:17:30 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] Creating offline snapshot 5be79311-6b0f-41ed-aa71-f44429783d67 of volume bf77acab-35e1-476d-a4f4-3ec7bd6032ca {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[049fd7b3-c1e0-4eb7-995f-92511769f82a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:31 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca Sep 04 06:17:31 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:31 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2" returned: 0 in 0.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:31 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2 Sep 04 06:17:31 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:31 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:31 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 1G Sep 04 06:17:31 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:31 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834.faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2" released by "_delete_snapshot" :: held 1.438s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-c624ed06-3307-49fa-a2a5-8a93be0c6834" released by "delete_snapshot" :: held 1.462s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Created reservations ['314b776d-7890-4979-b9e1-333f64e421a6', '94b76bc8-f646-47c6-9161-eb090ea9e6e1', '571f28ad-b997-4eef-9b53-3b75c8d42acb', 'c9759ef9-3f79-4074-8ae6-98fe2a0b0a35'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Delete snapshot completed successfully. Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-019d5a40-581b-47ce-8387-7ebb0a0b220d tempest-ProjectMemberTests-157241486 None] Lock "cinder-faeec92c-a93a-4f9c-9f36-e0d9c4cdbcf2-delete_snapshot" released by "delete_snapshot" :: held 1.599s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:31 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 1G" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:31 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 Sep 04 06:17:31 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:31 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:31 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 is being set with open permissions: ugo+rw Sep 04 06:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:31 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 Sep 04 06:17:31 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-c624ed06-3307-49fa-a2a5-8a93be0c6834-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Lock "cinder-c624ed06-3307-49fa-a2a5-8a93be0c6834-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-c624ed06-3307-49fa-a2a5-8a93be0c6834" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-c624ed06-3307-49fa-a2a5-8a93be0c6834" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82a8093-671c-443b-a4d5-acfcd9085c9e]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:32 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67" returned: 0 in 0.252s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:32 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.info Sep 04 06:17:32 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:32 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 Sep 04 06:17:32 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:32 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.info" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:32 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.info is being set with open permissions: ugo+rw Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:32 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.info Sep 04 06:17:32 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:32 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:32 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834 Sep 04 06:17:32 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:32 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.info" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:32 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c624ed06-3307-49fa-a2a5-8a93be0c6834" returned: 0 in 0.230s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-c624ed06-3307-49fa-a2a5-8a93be0c6834" released by "delete_volume" :: held 0.643s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b9a5a9e8-6db8-4e75-82ed-e7cc4d20fdce tempest-ProjectReaderTests-1022205293 None] Create snapshot completed successfully Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Created reservations ['0f83f4f8-be07-449a-9025-a74a265c72bd', '96643db0-b939-4960-8680-c055070a8f27', 'f5289fef-72a0-464a-a1db-f6df17c3b780', '599e2271-21eb-4965-b985-4707cb215f3f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:32 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:32 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-5be79311-6b0f-41ed-aa71-f44429783d67-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-5be79311-6b0f-41ed-aa71-f44429783d67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-bf77acab-35e1-476d-a4f4-3ec7bd6032ca" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-bf77acab-35e1-476d-a4f4-3ec7bd6032ca" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-5be79311-6b0f-41ed-aa71-f44429783d67" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-5be79311-6b0f-41ed-aa71-f44429783d67" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Deleting offline snapshot 5be79311-6b0f-41ed-aa71-f44429783d67 of volume bf77acab-35e1-476d-a4f4-3ec7bd6032ca {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] snapshot_file for this snap is: volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:17:33 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17c23ea-b979-40d0-88d3-d1b2756e843a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Deleted volume successfully. Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02f225fc-f810-4008-bf7b-b07f8f69bc73 tempest-ProjectMemberTests-157241486 None] Lock "cinder-c624ed06-3307-49fa-a2a5-8a93be0c6834-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:33 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 Sep 04 06:17:33 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:33 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b13e70-b536-4726-91cb-a0b8d0eab2b1]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (2d25b8df-b867-4bb5-b196-da0662da3a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2994698-82c5-477b-b85e-5666f040cf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:33 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca Sep 04 06:17:33 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2994698-82c5-477b-b85e-5666f040cf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1252301514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:34Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d49be0-c993-40d9-bcf3-754020d4643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d49be0-c993-40d9-bcf3-754020d4643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d74ca72-17cf-41dc-8257-e4c13146fced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d74ca72-17cf-41dc-8257-e4c13146fced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5', 'volume_name': 'volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ed804c-9164-4d37-99cf-54860febbdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ed804c-9164-4d37-99cf-54860febbdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa4120b-fb2d-4e3f-917d-3f879f340314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Volume bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5', 'volume_size': 1} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1252301514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:34Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Creating volume bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:33 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:33 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 1073741824 Sep 04 06:17:33 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:33 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:33 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 Sep 04 06:17:33 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:34 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 1073741824" returned: 0 in 0.444s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:34 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 Sep 04 06:17:34 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:34 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67" returned: 0 in 0.373s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:34 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67 Sep 04 06:17:34 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:34 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa4120b-fb2d-4e3f-917d-3f879f340314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3227711a-e713-41a3-adb1-9c0611e48d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Volume volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 (bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5): created successfully Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3227711a-e713-41a3-adb1-9c0611e48d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (2d25b8df-b867-4bb5-b196-da0662da3a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:34 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca.5be79311-6b0f-41ed-aa71-f44429783d67" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-5be79311-6b0f-41ed-aa71-f44429783d67" released by "_delete_snapshot" :: held 1.497s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e372e7e9-677d-4766-9e5f-e4b9c3967e1c tempest-ProjectMemberTests-157241486 None] Created volume successfully. Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-bf77acab-35e1-476d-a4f4-3ec7bd6032ca" released by "delete_snapshot" :: held 1.530s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Created reservations ['83759636-f2b6-4192-93be-6759ed1b1de5', '97e3cca5-15f4-402d-866c-f3f6564d0663', '37cc6b22-ba5b-41a3-9ba5-c616f02a3704', 'ba442b85-ba67-4b5d-9edc-c051193b318c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Delete snapshot completed successfully. Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f9a7fcb7-fde8-4de4-a23e-87ff5b060ea1 tempest-ProjectReaderTests-1022205293 None] Lock "cinder-5be79311-6b0f-41ed-aa71-f44429783d67-delete_snapshot" released by "delete_snapshot" :: held 1.667s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] Creating offline snapshot 0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 of volume bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[91552518-1a1e-4d6d-9449-0cea1814ad7a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:34 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 Sep 04 06:17:34 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-bf77acab-35e1-476d-a4f4-3ec7bd6032ca-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Lock "cinder-bf77acab-35e1-476d-a4f4-3ec7bd6032ca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:35 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:35 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 1G Sep 04 06:17:35 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Acquiring lock "cinder-quobyte-bf77acab-35e1-476d-a4f4-3ec7bd6032ca" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-bf77acab-35e1-476d-a4f4-3ec7bd6032ca" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c5febf-cf3e-4bc4-ab11-21a55788d333]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:35 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca Sep 04 06:17:35 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:35 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 1G" returned: 0 in 0.402s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:35 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 Sep 04 06:17:35 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:35 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca" returned: 0 in 0.371s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:35 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca Sep 04 06:17:35 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:35 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371" returned: 0 in 0.297s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:35 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 is being set with open permissions: ugo+rw Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:35 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bf77acab-35e1-476d-a4f4-3ec7bd6032ca" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:35 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 Sep 04 06:17:35 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Lock "cinder-quobyte-bf77acab-35e1-476d-a4f4-3ec7bd6032ca" released by "delete_volume" :: held 0.673s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Created reservations ['9cf802dc-5f93-44c8-9ab0-450a7e061c01', '3781c5c6-4eb2-45f7-a0d1-75e5af48ac5b', '6ed4672c-6d36-4fc7-a290-baa5dd866efa', '392cb627-dbc8-4bfc-8a9b-0501bfba3a54'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:36 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:36 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:36 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:36 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.info Sep 04 06:17:36 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:36 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.259s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Deleted volume successfully. Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-95c2c54c-a96d-4219-b538-c4179209c9af tempest-ProjectReaderTests-1022205293 None] Lock "cinder-bf77acab-35e1-476d-a4f4-3ec7bd6032ca-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:36 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.info" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:36 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.info is being set with open permissions: ugo+rw Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:36 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.info Sep 04 06:17:36 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:36 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.info" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4ea95712-7a7b-4064-9c85-ed1a4bf254cf tempest-ProjectMemberTests-157241486 None] Create snapshot completed successfully Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Lock "cinder-0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Deleting offline snapshot 0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 of volume bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] snapshot_file for this snap is: volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9c976a-674d-4bd4-942a-ba67e4c7f5f7]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:37 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 Sep 04 06:17:37 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:37 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371" returned: 0 in 0.392s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7b360d-1d9c-4e5b-b07c-14c6f9f1f12a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:37 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 Sep 04 06:17:37 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:37 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5" returned: 0 in 0.396s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:37 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 Sep 04 06:17:37 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:38 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:38 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371 Sep 04 06:17:38 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:38 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5.0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371" returned: 0 in 0.237s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371" released by "_delete_snapshot" :: held 1.463s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5" released by "delete_snapshot" :: held 1.487s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:38 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Created reservations ['a182c2d1-7a90-4d0e-abb0-c6592edac0bc', 'a4a72fc5-dfcb-43b9-82d6-a7d1ec9b0f90', 'ea30f687-fe25-4188-a994-a3b27a7164ca', '0c0e0755-e8f4-4762-9c02-52975df86375'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Delete snapshot completed successfully. Sep 04 06:17:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d343f175-f2b2-40dc-8ebc-72971135e932 tempest-ProjectMemberTests-157241486 None] Lock "cinder-0b1b0dfa-44a0-4e00-90b0-aefbd6fbc371-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Lock "cinder-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5" acquired by "delete_volume" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b518235b-70b1-4641-be98-7b25ede532bb]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:39 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 Sep 04 06:17:39 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:39 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:39 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5 Sep 04 06:17:39 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:39 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5" released by "delete_volume" :: held 0.702s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:39 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Created reservations ['03c02f29-82eb-4d51-b89c-a8151517fae2', '03cac168-7834-4588-aa32-cec906b7e549', '4400993e-53ac-419a-a86d-aab2208754ed', '34e4fe07-0c51-4b8d-a871-f71adb6ed4eb'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:40 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:40 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:40 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Deleted volume successfully. Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7eaabcf9-6910-4269-99eb-81d67be524bf tempest-ProjectMemberTests-157241486 None] Lock "cinder-bc25bd0d-e8e8-4fdc-80bb-ff94dcd2bcf5-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (d9e9a0f3-1292-4832-b118-a1ddef9e17cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b764d2-f50e-40d9-a469-e41e2f1494c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b764d2-f50e-40d9-a469-e41e2f1494c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-983620058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab3959a-03a0-41f6-a9c8-1851a9b86860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:41Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7bfb42-e49d-4a30-8050-8611e631060b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7bfb42-e49d-4a30-8050-8611e631060b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3411a1-1be6-46af-a970-6710861d1b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3411a1-1be6-46af-a970-6710861d1b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab3959a-03a0-41f6-a9c8-1851a9b86860', 'volume_name': 'volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbd8728-1f57-43da-a35c-da99feacc816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbd8728-1f57-43da-a35c-da99feacc816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c197ff4f-a952-48e5-bf40-16719874bd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Volume 9ab3959a-03a0-41f6-a9c8-1851a9b86860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860', 'volume_size': 1} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-983620058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab3959a-03a0-41f6-a9c8-1851a9b86860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:41Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Creating volume 9ab3959a-03a0-41f6-a9c8-1851a9b86860 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:40 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:40 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 1073741824 Sep 04 06:17:40 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:41 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 1073741824" returned: 0 in 0.444s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=212,cinder:UPDATE=299,cinder:INSERT=84,cinder:DELETE=27 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=234,cinder:UPDATE=299,cinder:INSERT=70,cinder:DELETE=24 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:41 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 Sep 04 06:17:41 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:41 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860" returned: 0 in 0.254s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c197ff4f-a952-48e5-bf40-16719874bd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0cca0e-2368-4553-830c-0e508c04a74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Volume volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 (9ab3959a-03a0-41f6-a9c8-1851a9b86860): created successfully Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0cca0e-2368-4553-830c-0e508c04a74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (d9e9a0f3-1292-4832-b118-a1ddef9e17cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-36d0038d-804e-4a75-9864-c908abcc856d tempest-ProjectMemberTests-157241486 None] Created volume successfully. Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] Creating offline snapshot dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 of volume 9ab3959a-03a0-41f6-a9c8-1851a9b86860 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6739500-51c9-4cc8-9a89-25eb22cdd9bf]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:42 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 Sep 04 06:17:42 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:42 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860" returned: 0 in 0.367s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:42 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 1G Sep 04 06:17:42 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:42 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 1G" returned: 0 in 0.366s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:42 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 Sep 04 06:17:42 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:42 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:42 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 is being set with open permissions: ugo+rw Sep 04 06:17:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:43 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 Sep 04 06:17:43 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:43 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:43 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.info Sep 04 06:17:43 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:43 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.info" returned: 0 in 0.250s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:43 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.info is being set with open permissions: ugo+rw Sep 04 06:17:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:43 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.info Sep 04 06:17:43 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:43 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.info" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c012ec55-de56-4bc6-b15b-864c68932881 tempest-ProjectMemberTests-157241486 None] Create snapshot completed successfully Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Lock "cinder-dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-9ab3959a-03a0-41f6-a9c8-1851a9b86860" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-9ab3959a-03a0-41f6-a9c8-1851a9b86860" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Deleting offline snapshot dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 of volume 9ab3959a-03a0-41f6-a9c8-1851a9b86860 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] snapshot_file for this snap is: volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca48601-9a44-43ce-bc24-3d7c3dacf868]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:44 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 Sep 04 06:17:44 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:44 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7" returned: 0 in 0.372s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4733bc-3d85-419b-a59b-c4063d8dd016]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:44 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 Sep 04 06:17:44 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:44 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:44 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 Sep 04 06:17:44 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:45 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:45 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7 Sep 04 06:17:45 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:45 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860.dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7" released by "_delete_snapshot" :: held 1.450s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-9ab3959a-03a0-41f6-a9c8-1851a9b86860" released by "delete_snapshot" :: held 1.478s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:45 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Created reservations ['897cfefe-1bbd-4bd1-a043-a085c4cf3311', '7d9c53f0-b0d4-442b-b8e6-312cacc2026e', 'dddff0c5-3bc4-46a3-a9d1-ff2ffa7014ee', 'eea802c0-f456-4383-a6da-d9d3ab40a0a7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Delete snapshot completed successfully. Sep 04 06:17:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7de9f2-3871-48c7-a2fa-cddd1d4d6f29 tempest-ProjectMemberTests-157241486 None] Lock "cinder-dfeae1b4-a3c1-40a8-aa6a-0eefa01eead7-delete_snapshot" released by "delete_snapshot" :: held 1.627s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-9ab3959a-03a0-41f6-a9c8-1851a9b86860-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Lock "cinder-9ab3959a-03a0-41f6-a9c8-1851a9b86860-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-9ab3959a-03a0-41f6-a9c8-1851a9b86860" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-9ab3959a-03a0-41f6-a9c8-1851a9b86860" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09763c5-3369-4f45-8454-2417745db359]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:46 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 Sep 04 06:17:46 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:46 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:46 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860 Sep 04 06:17:46 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:47 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-9ab3959a-03a0-41f6-a9c8-1851a9b86860" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-9ab3959a-03a0-41f6-a9c8-1851a9b86860" released by "delete_volume" :: held 0.702s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Created reservations ['a16d0d75-de0a-4c71-99ea-18d3058bbef8', '088d7c92-3a8c-4f0d-bcd1-d888232aff58', '0e8846c0-e8c3-4da9-9ec3-2bf36a3d5897', '6393c6f7-caa5-4fe4-9037-1fc7ffa9f483'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:47 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:47 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:47 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Deleted volume successfully. Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86c60878-55f4-4ca9-aa2b-8fcc51e9230e tempest-ProjectMemberTests-157241486 None] Lock "cinder-9ab3959a-03a0-41f6-a9c8-1851a9b86860-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (7159b7fe-5450-49c1-9eb2-ed8db6bc48d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046c2859-08c5-46a4-867f-dd33761a4256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046c2859-08c5-46a4-867f-dd33761a4256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758128803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a5ee24-98ec-4a9a-ae5b-5776981b591d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:48Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e310fe7f-bd39-417c-8547-7f0847a5867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e310fe7f-bd39-417c-8547-7f0847a5867f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cbae7b-5708-4bd6-8d3a-dfef12cef115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cbae7b-5708-4bd6-8d3a-dfef12cef115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a5ee24-98ec-4a9a-ae5b-5776981b591d', 'volume_name': 'volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0dc7923-a155-4640-9573-72306d0bbce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0dc7923-a155-4640-9573-72306d0bbce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fc36b8-9732-44a7-9173-8acdbecaa6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Volume 38a5ee24-98ec-4a9a-ae5b-5776981b591d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d', 'volume_size': 1} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758128803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a5ee24-98ec-4a9a-ae5b-5776981b591d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:48Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Creating volume 38a5ee24-98ec-4a9a-ae5b-5776981b591d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:48 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:48 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d 1073741824 Sep 04 06:17:48 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:48 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d 1073741824" returned: 0 in 0.429s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:48 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d Sep 04 06:17:48 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:48 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d" returned: 0 in 0.250s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fc36b8-9732-44a7-9173-8acdbecaa6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de38fba-7b07-47ce-a1d4-9dab8e9dc1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Volume volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d (38a5ee24-98ec-4a9a-ae5b-5776981b591d): created successfully Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de38fba-7b07-47ce-a1d4-9dab8e9dc1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (7159b7fe-5450-49c1-9eb2-ed8db6bc48d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-adc72af8-5468-40e5-9037-3d0ca10f939c tempest-ProjectMemberTests-157241486 None] Created volume successfully. Sep 04 06:17:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] Creating offline snapshot 3a45a632-efaa-41ce-bac6-3aa1b0ff433b of volume 38a5ee24-98ec-4a9a-ae5b-5776981b591d {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:17:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0f13f1-9536-46b0-b1cf-a8af6afa7683]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:49 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d Sep 04 06:17:49 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:49 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:49 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b 1G Sep 04 06:17:49 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:49 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b 1G" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:49 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b Sep 04 06:17:49 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:50 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b" returned: 0 in 0.279s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:50 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b is being set with open permissions: ugo+rw Sep 04 06:17:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:50 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b Sep 04 06:17:50 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:50 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b" returned: 0 in 0.231s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:50 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.info Sep 04 06:17:50 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:50 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.info" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:50 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.info is being set with open permissions: ugo+rw Sep 04 06:17:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:50 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.info Sep 04 06:17:50 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:50 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.info" returned: 0 in 0.228s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-718bac8c-5735-44d7-8880-a35f48a52718 tempest-ProjectMemberTests-157241486 None] Create snapshot completed successfully Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-3a45a632-efaa-41ce-bac6-3aa1b0ff433b-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Lock "cinder-3a45a632-efaa-41ce-bac6-3aa1b0ff433b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-38a5ee24-98ec-4a9a-ae5b-5776981b591d" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-38a5ee24-98ec-4a9a-ae5b-5776981b591d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-3a45a632-efaa-41ce-bac6-3aa1b0ff433b" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-3a45a632-efaa-41ce-bac6-3aa1b0ff433b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Deleting offline snapshot 3a45a632-efaa-41ce-bac6-3aa1b0ff433b of volume 38a5ee24-98ec-4a9a-ae5b-5776981b591d {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] snapshot_file for this snap is: volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0722487c-3e5e-419a-9d55-9f54c54d61f0]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:51 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b Sep 04 06:17:51 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:51 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fc4bd4-0ca3-4359-866e-eef597c91fd6]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:51 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d Sep 04 06:17:51 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:52 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:52 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b Sep 04 06:17:52 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:52 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b" returned: 0 in 0.326s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:52 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b Sep 04 06:17:52 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:52 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d.3a45a632-efaa-41ce-bac6-3aa1b0ff433b" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-3a45a632-efaa-41ce-bac6-3aa1b0ff433b" released by "_delete_snapshot" :: held 1.398s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-38a5ee24-98ec-4a9a-ae5b-5776981b591d" released by "delete_snapshot" :: held 1.424s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Created reservations ['2f0bf445-9a60-47b1-904e-ee10405bb0bc', 'b2fef338-4dcf-4f24-9853-b78b767f0241', '31dce169-0225-46b7-b6f6-de728f36edff', '1354a83f-4ea0-42b3-95e2-47d3fce51ade'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Delete snapshot completed successfully. Sep 04 06:17:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3fe4d4d-38cf-4348-a8e4-8cd07b026283 tempest-ProjectMemberTests-157241486 None] Lock "cinder-3a45a632-efaa-41ce-bac6-3aa1b0ff433b-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-38a5ee24-98ec-4a9a-ae5b-5776981b591d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Lock "cinder-38a5ee24-98ec-4a9a-ae5b-5776981b591d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-38a5ee24-98ec-4a9a-ae5b-5776981b591d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-38a5ee24-98ec-4a9a-ae5b-5776981b591d" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42b2e6e-8dff-4617-8c25-73258f3e7f7a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:53 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d Sep 04 06:17:53 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:53 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:53 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d Sep 04 06:17:53 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:54 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-38a5ee24-98ec-4a9a-ae5b-5776981b591d" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-38a5ee24-98ec-4a9a-ae5b-5776981b591d" released by "delete_volume" :: held 0.646s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Created reservations ['43e516ac-518c-44c7-96ba-d799dd0455dd', '045f4024-b6aa-4ba9-9e78-03a3fb7930f4', '665cf3c1-ae58-4df9-a9da-344673f2ccc0', '010e6524-7fd2-4926-9592-733339911f1c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:54 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:17:54 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:54 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:17:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Deleted volume successfully. Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6093bd7c-a3ac-4ca2-bcfb-99d7d50c2676 tempest-ProjectMemberTests-157241486 None] Lock "cinder-38a5ee24-98ec-4a9a-ae5b-5776981b591d-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:17:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (dde62cdc-49c0-4f27-88cb-c13334759614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dded557e-d891-4cd8-9441-aed3c3580305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dded557e-d891-4cd8-9441-aed3c3580305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480923777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b451f1-68e1-4a7a-92f3-e9ef9c8449fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:55Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649caa7e-78ec-4f93-8a98-e99a598a41a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649caa7e-78ec-4f93-8a98-e99a598a41a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc65007-8886-44c3-af20-1226a5d03937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc65007-8886-44c3-af20-1226a5d03937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b451f1-68e1-4a7a-92f3-e9ef9c8449fd', 'volume_name': 'volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51423f5b-ff96-4890-94c6-c4b47f76b42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51423f5b-ff96-4890-94c6-c4b47f76b42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec66d9b3-435e-40dd-b263-e1321ea74676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Volume 92b451f1-68e1-4a7a-92f3-e9ef9c8449fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd', 'volume_size': 1} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480923777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b451f1-68e1-4a7a-92f3-e9ef9c8449fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:17:55Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Creating volume 92b451f1-68e1-4a7a-92f3-e9ef9c8449fd {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:17:55 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:55 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd 1073741824 Sep 04 06:17:55 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:55 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd 1073741824" returned: 0 in 0.448s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:55 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd Sep 04 06:17:55 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:55 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec66d9b3-435e-40dd-b263-e1321ea74676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4620142-9c1f-4804-a4f0-438bd7644eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:17:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Volume volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd (92b451f1-68e1-4a7a-92f3-e9ef9c8449fd): created successfully Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4620142-9c1f-4804-a4f0-438bd7644eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:17:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (dde62cdc-49c0-4f27-88cb-c13334759614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:17:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9cb688e3-d036-4e77-a3ff-9549617270b9 tempest-ProjectMemberTests-157241486 None] Created volume successfully. Sep 04 06:17:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:17:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:17:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] Creating offline snapshot 1aef3aa9-220e-4013-b587-639a966d62f0 of volume 92b451f1-68e1-4a7a-92f3-e9ef9c8449fd {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:17:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb02ef81-3dc9-4233-890a-284e67519431]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:56 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd Sep 04 06:17:56 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:56 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:56 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 1G Sep 04 06:17:56 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:56 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 1G" returned: 0 in 0.389s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:56 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 Sep 04 06:17:56 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:57 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:57 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 is being set with open permissions: ugo+rw Sep 04 06:17:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:57 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 Sep 04 06:17:57 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:57 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0" returned: 0 in 0.250s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:57 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.info Sep 04 06:17:57 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:57 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.info" returned: 0 in 0.260s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:57 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.info is being set with open permissions: ugo+rw Sep 04 06:17:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:57 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.info Sep 04 06:17:57 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:57 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.info" returned: 0 in 0.227s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:17:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c99f2d82-13b9-4a8a-9b1e-f18293f7c738 tempest-ProjectMemberTests-157241486 None] Create snapshot completed successfully Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-1aef3aa9-220e-4013-b587-639a966d62f0-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Lock "cinder-1aef3aa9-220e-4013-b587-639a966d62f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-1aef3aa9-220e-4013-b587-639a966d62f0" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-1aef3aa9-220e-4013-b587-639a966d62f0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Deleting offline snapshot 1aef3aa9-220e-4013-b587-639a966d62f0 of volume 92b451f1-68e1-4a7a-92f3-e9ef9c8449fd {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] snapshot_file for this snap is: volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbb3d49-acd2-47de-b3d2-bdf47ee42a32]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:58 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 Sep 04 06:17:58 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:58 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb0bc49-12b1-4a32-bdd3-c81f8e0add26]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:17:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:58 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd Sep 04 06:17:58 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:59 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:59 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 Sep 04 06:17:59 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:59 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0" returned: 0 in 0.323s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:17:59 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0 Sep 04 06:17:59 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:17:59 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 04 06:17:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd.1aef3aa9-220e-4013-b587-639a966d62f0" returned: 0 in 0.243s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:17:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-1aef3aa9-220e-4013-b587-639a966d62f0" released by "_delete_snapshot" :: held 1.352s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd" released by "delete_snapshot" :: held 1.375s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:17:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Created reservations ['ec5a4aeb-bf17-42e3-9268-eb4f1fb296b8', '57ba8f8c-d855-4f82-b754-2bf3c6b99b3e', '6a5ddbe9-f930-47fe-8b4a-8f7f2e4e2b9d', '445b0893-9640-4f88-a9b0-a1b580e13f6f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:17:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Delete snapshot completed successfully. Sep 04 06:17:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09941433-d02c-4a9b-9077-de19fed545a4 tempest-ProjectMemberTests-157241486 None] Lock "cinder-1aef3aa9-220e-4013-b587-639a966d62f0-delete_snapshot" released by "delete_snapshot" :: held 1.501s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:18:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Lock "cinder-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:18:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:18:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:18:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f6d9ad-d891-47b9-ad4a-126fd1b72053]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:18:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:00 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd Sep 04 06:18:00 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:00 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd" returned: 0 in 0.373s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:00 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd Sep 04 06:18:00 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:01 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd" released by "delete_volume" :: held 0.668s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:01 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Created reservations ['8ffef91a-22bb-4159-8cce-f2d8b7b916eb', '204aab59-8904-45df-a49c-168f6b614473', '94727230-349c-4312-bfac-5652f0155810', '40cce752-db91-475d-8044-211fb8192d01'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:18:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:18:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:18:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:18:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:18:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:18:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:01 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:18:01 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:01 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.225s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:01 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:18:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Deleted volume successfully. Sep 04 06:18:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6b3f34a3-314d-4e6f-827b-f6721635dbe9 tempest-ProjectMemberTests-157241486 None] Lock "cinder-92b451f1-68e1-4a7a-92f3-e9ef9c8449fd-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (2c907a0e-2d93-464a-af48-673eea5ad106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae99b413-1bae-4aef-93ea-3df431bcfa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae99b413-1bae-4aef-93ea-3df431bcfa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1803367026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d354b3-2b94-45db-960c-ab8a55a9a340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:18:02Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69362b72-c6fc-4236-a8fd-63e5196fa318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69362b72-c6fc-4236-a8fd-63e5196fa318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30bec82-d609-4d45-9801-fccc6af37024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30bec82-d609-4d45-9801-fccc6af37024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d354b3-2b94-45db-960c-ab8a55a9a340', 'volume_name': 'volume-c2d354b3-2b94-45db-960c-ab8a55a9a340', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47ff949-13ad-4c49-ae1e-e5aa86c7dccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47ff949-13ad-4c49-ae1e-e5aa86c7dccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3d0f7a-d076-4206-b20a-955004b33a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:18:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Volume c2d354b3-2b94-45db-960c-ab8a55a9a340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d354b3-2b94-45db-960c-ab8a55a9a340', 'volume_size': 1} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1803367026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d354b3-2b94-45db-960c-ab8a55a9a340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:18:02Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Creating volume c2d354b3-2b94-45db-960c-ab8a55a9a340 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:18:02 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:02 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 1073741824 Sep 04 06:18:02 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:02 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 1073741824" returned: 0 in 0.384s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:02 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 Sep 04 06:18:02 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:02 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3d0f7a-d076-4206-b20a-955004b33a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d354b3-2b94-45db-960c-ab8a55a9a340', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49aa3b75-af75-4d61-b1e8-5ce9cf1c85d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:18:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Volume volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 (c2d354b3-2b94-45db-960c-ab8a55a9a340): created successfully Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49aa3b75-af75-4d61-b1e8-5ce9cf1c85d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:18:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (2c907a0e-2d93-464a-af48-673eea5ad106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:18:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f07c9979-e081-42a7-a84c-67a998c6d95d tempest-ProjectMemberTests-157241486 None] Created volume successfully. Sep 04 06:18:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:18:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:18:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] Creating offline snapshot d1266d2e-3603-4ed6-943f-6d8f1978f3ae of volume c2d354b3-2b94-45db-960c-ab8a55a9a340 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:18:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5e9197-9837-477d-b914-a0008cbcb28e]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:18:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:03 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 Sep 04 06:18:03 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:03 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340" returned: 0 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:03 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae 1G Sep 04 06:18:03 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:03 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae 1G" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:03 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae Sep 04 06:18:03 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:04 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:04 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae is being set with open permissions: ugo+rw Sep 04 06:18:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:04 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae Sep 04 06:18:04 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:04 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae" returned: 0 in 0.235s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:04 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.info Sep 04 06:18:04 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:04 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.info" returned: 0 in 0.235s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:04 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.info is being set with open permissions: ugo+rw Sep 04 06:18:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:04 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.info Sep 04 06:18:04 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:04 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.info" returned: 0 in 0.230s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.748s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:18:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5d3327d4-d5b0-4f84-99a9-82f7cd0d38a5 tempest-ProjectMemberTests-157241486 None] Create snapshot completed successfully Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-d1266d2e-3603-4ed6-943f-6d8f1978f3ae-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Lock "cinder-d1266d2e-3603-4ed6-943f-6d8f1978f3ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-c2d354b3-2b94-45db-960c-ab8a55a9a340" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-c2d354b3-2b94-45db-960c-ab8a55a9a340" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-d1266d2e-3603-4ed6-943f-6d8f1978f3ae" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-d1266d2e-3603-4ed6-943f-6d8f1978f3ae" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Deleting offline snapshot d1266d2e-3603-4ed6-943f-6d8f1978f3ae of volume c2d354b3-2b94-45db-960c-ab8a55a9a340 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] snapshot_file for this snap is: volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce9b5a0-721c-4c11-8b09-5216e4d529fb]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:05 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae Sep 04 06:18:05 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:05 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae" returned: 0 in 0.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2d354b3-2b94-45db-960c-ab8a55a9a340(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[be504be4-5ed7-4a64-8ff7-c47434b3940b]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:18:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:05 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 Sep 04 06:18:05 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:06 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:06 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae Sep 04 06:18:06 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:06 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:06 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae Sep 04 06:18:06 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:06 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340.d1266d2e-3603-4ed6-943f-6d8f1978f3ae" returned: 0 in 0.233s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-d1266d2e-3603-4ed6-943f-6d8f1978f3ae" released by "_delete_snapshot" :: held 1.341s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-c2d354b3-2b94-45db-960c-ab8a55a9a340" released by "delete_snapshot" :: held 1.359s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:06 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Created reservations ['d32595e2-7817-45d4-abd1-40e1e3586bc4', '91ded03c-b47f-45f4-bd63-1798cf0b26db', '600534a9-5a3f-4909-ab50-16bef44a58b9', '8f4ada8c-e1c3-4216-8071-d4f8273605d4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:18:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Delete snapshot completed successfully. Sep 04 06:18:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3511a281-d374-4648-82e2-e2ffa5c89537 tempest-ProjectMemberTests-157241486 None] Lock "cinder-d1266d2e-3603-4ed6-943f-6d8f1978f3ae-delete_snapshot" released by "delete_snapshot" :: held 1.479s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-c2d354b3-2b94-45db-960c-ab8a55a9a340-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:18:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Lock "cinder-c2d354b3-2b94-45db-960c-ab8a55a9a340-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:18:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-c2d354b3-2b94-45db-960c-ab8a55a9a340" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:18:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-c2d354b3-2b94-45db-960c-ab8a55a9a340" acquired by "delete_volume" :: waited 0.012s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:18:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba94770-66cd-48f1-bacc-bfe298e511b4]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:18:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:07 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 Sep 04 06:18:07 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:07 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:07 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340 Sep 04 06:18:07 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:08 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-c2d354b3-2b94-45db-960c-ab8a55a9a340" returned: 0 in 0.234s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-c2d354b3-2b94-45db-960c-ab8a55a9a340" released by "delete_volume" :: held 0.625s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Created reservations ['1c369d78-6588-4f0f-a40a-624f2d0c9cd1', '64a13899-535e-4c2e-84b7-c3a303433360', '0d8d972d-5287-41c3-bcb8-ab57bdbcc285', 'a823a927-7824-41c3-afaa-dec7bae28be4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:08 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:18:08 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:08 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.227s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:18:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Deleted volume successfully. Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402586c2-817a-401c-a5b3-62a6f7f9bd2a tempest-ProjectMemberTests-157241486 None] Lock "cinder-c2d354b3-2b94-45db-960c-ab8a55a9a340-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:08 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (9fa1683a-3bad-42a7-ad39-dc611556c7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c91b497-22c1-4aea-b46f-dbc550c49c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c91b497-22c1-4aea-b46f-dbc550c49c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1979325702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe1854e-135e-4cd3-a246-c7da5b9dc8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:18:09Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d385555-ce01-4da1-af8b-680147435069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d385555-ce01-4da1-af8b-680147435069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a006c7-d21f-4c2a-b999-3aef1d08b2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a006c7-d21f-4c2a-b999-3aef1d08b2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fe1854e-135e-4cd3-a246-c7da5b9dc8f6', 'volume_name': 'volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19dacd7-425f-45a7-bbfe-1bffad949d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19dacd7-425f-45a7-bbfe-1bffad949d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3977fb48-3b85-4f60-9c08-882ee54f014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:18:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Volume 6fe1854e-135e-4cd3-a246-c7da5b9dc8f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6', 'volume_size': 1} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T04:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1979325702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe1854e-135e-4cd3-a246-c7da5b9dc8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c2f105cfab45e392b301d23c9aa3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:18:09Z,use_quota=True,user_id='8ba0b8b11f5e4ee8b5983c6145b47527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fe129-a032-4f96-b9e3-730349bb7bf2),volume_type_id=bb5fe129-a032-4f96-b9e3-730349bb7bf2)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Creating volume 6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Selected osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 06:18:09 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] casted to osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2 Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:09 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 1073741824 Sep 04 06:18:09 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:09 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 1073741824" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:09 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 Sep 04 06:18:09 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:09 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6" returned: 0 in 0.236s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3977fb48-3b85-4f60-9c08-882ee54f014f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63132e0-f25b-4724-bd41-e2cdd5ad62e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 06:18:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Volume volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 (6fe1854e-135e-4cd3-a246-c7da5b9dc8f6): created successfully Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63132e0-f25b-4724-bd41-e2cdd5ad62e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 06:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Flow 'volume_create_manager' (9fa1683a-3bad-42a7-ad39-dc611556c7d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 06:18:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-490afa55-0b71-44b5-a49e-cd010e9072ac tempest-ProjectMemberTests-157241486 None] Created volume successfully. Sep 04 06:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] Creating offline snapshot 717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 of volume 6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 06:18:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0665b600-f727-4bb6-82ac-031754ddb8e8]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:10 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 Sep 04 06:18:10 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:10 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:10 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 1G Sep 04 06:18:10 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:10 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 1G" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:10 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 Sep 04 06:18:10 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:11 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 -F qcow2 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:11 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 is being set with open permissions: ugo+rw Sep 04 06:18:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:11 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 Sep 04 06:18:11 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:11 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579" returned: 0 in 0.230s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:11 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.info Sep 04 06:18:11 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:11 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.info" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:11 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.info is being set with open permissions: ugo+rw Sep 04 06:18:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:11 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.info Sep 04 06:18:11 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:11 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.info" returned: 0 in 0.237s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.767s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:18:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ffc2f3e8-2228-4eb3-b4a9-822e425db454 tempest-ProjectMemberTests-157241486 None] Create snapshot completed successfully Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Lock "cinder-717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Deleting offline snapshot 717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 of volume 6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] snapshot_file for this snap is: volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cbae17-2625-4b5e-a21f-612a5ac3c87a]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:12 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 Sep 04 06:18:12 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:12 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40c094e-c452-4ec5-8cbd-f7944c517331]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:18:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:12 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 Sep 04 06:18:12 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:13 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:13 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 Sep 04 06:18:13 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:13 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:13 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579 Sep 04 06:18:13 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:13 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6.717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579" returned: 0 in 0.231s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579" released by "_delete_snapshot" :: held 1.293s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6" released by "delete_snapshot" :: held 1.315s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Created reservations ['ade6dc5e-7c25-416c-8379-aeabd28a6fb3', 'c2f661c9-c522-489f-aa02-7ef230bbe67a', 'bac21cd5-5f47-44a3-86aa-fc0d2689d309', 'b1660d45-1c2f-48a1-8ac2-ccde6ca4947b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:18:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Delete snapshot completed successfully. Sep 04 06:18:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5414a9-05ae-4cff-ae11-487e92563431 tempest-ProjectMemberTests-157241486 None] Lock "cinder-717a66a6-ab2d-4ea0-9a9f-4ab6d5e12579-delete_snapshot" released by "delete_snapshot" :: held 1.453s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:18:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Lock "cinder-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:18:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Acquiring lock "cinder-quobyte-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 06:18:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 06:18:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c8cff8-af13-4032-b011-1dd2be0067b3]: (4, 'qcow2') {{(pid=89022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 06:18:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:14 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 Sep 04 06:18:14 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:14 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:14 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6 Sep 04 06:18:14 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:15 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6/volume-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Lock "cinder-quobyte-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6" released by "delete_volume" :: held 0.629s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Created reservations ['2e34e47b-1342-4a18-a425-f63f67e531f8', 'bb132101-79de-40b4-bd43-1bfe7cdac4fb', '381be0c5-2a49-4d32-b82d-5871c393ba51', '2dbce497-c90f-46a9-b316-a53866335a49'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 06:18:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:18:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:18:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:18:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:18:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:18:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:15 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:18:15 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:15 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.234s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:15 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:18:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Deleted volume successfully. Sep 04 06:18:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28574f44-098e-4524-8af6-d7e6de73e0fa tempest-ProjectMemberTests-157241486 None] Lock "cinder-6fe1854e-135e-4cd3-a246-c7da5b9dc8f6-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=88,cinder:DELETE=9,cinder:SELECT=70,cinder:INSERT=31 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd0fd8e7-10e1-4aaf-a075-79deee1e7cb2'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 06:18:25 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6 Sep 04 06:18:25 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=68,cinder:INSERT=19,cinder:UPDATE=91,cinder:DELETE=6 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 06:18:25 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/087fb657bbddbf5136760c88ec1904d6" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread count: 29 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 06:18:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1148cf73-471d-44bb-b411-8f4a7e0272e4 None None] thread info: [<_MainThread(MainThread, started 138540324388992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}